-- Logs begin at Wed 2022-03-30 06:35:16 UTC, end at Wed 2022-03-30 07:32:58 UTC. -- Mar 30 07:06:59.510554 dv-cinder-835778-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 30 07:06:59.520111 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Mar 30 07:06:59 2022] *** Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: nodename: dv-cinder-835778-2-iscsi Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: machine: x86_64 Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: clock source: unix Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: pcre jit disabled Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: detected number of CPU cores: 4 Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: current working directory: / Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: detected binary path: /usr/bin/uwsgi-core Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: your processes number limit is 47680 Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: your memory page size is 4096 bytes Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: detected max file descriptor number: 2048 Mar 30 07:06:59.522138 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: lock engine: pthread robust mutexes Mar 30 07:06:59.523128 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: thunder lock: enabled Mar 30 07:06:59.523128 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 30 07:06:59.523128 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 30 07:06:59.569174 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: Python main interpreter initialized at 0x56304d7339c0 Mar 30 07:06:59.569174 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: python threads support enabled Mar 30 07:06:59.569174 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: your server socket listen backlog is limited to 100 connections Mar 30 07:06:59.569174 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: your mercy for graceful operations on workers is 90 seconds Mar 30 07:06:59.569532 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: mapped 403077 bytes (393 KB) for 2 cores Mar 30 07:06:59.569532 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: *** Operational MODE: preforking *** Mar 30 07:06:59.569836 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: *** uWSGI is running in multiple interpreter mode *** Mar 30 07:06:59.569836 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: spawned uWSGI master process (pid: 102736) Mar 30 07:06:59.570036 dv-cinder-835778-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 30 07:06:59.570708 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: spawned uWSGI worker 1 (pid: 102737, cores: 1) Mar 30 07:06:59.570990 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: spawned uWSGI worker 2 (pid: 102738, cores: 1) Mar 30 07:06:59.571074 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 30 07:07:00.730969 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 30 07:07:00.735374 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 30 07:07:01.577620 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:07:01.577620 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: from cryptography.utils import int_from_bytes Mar 30 07:07:01.577898 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:07:01.577898 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: from cryptography.utils import int_from_bytes Mar 30 07:07:01.578017 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:07:01.578017 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: from cryptography.utils import int_from_bytes Mar 30 07:07:01.578150 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:07:01.578150 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: from cryptography.utils import int_from_bytes Mar 30 07:07:04.108942 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 30 07:07:04.109664 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 30 07:07:04.109664 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 30 07:07:04.110073 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 30 07:07:04.110231 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 30 07:07:04.110618 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 30 07:07:04.110700 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 30 07:07:04.110780 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.110920 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 30 07:07:04.111015 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.111311 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 30 07:07:04.111445 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.111536 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 30 07:07:04.111606 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.111963 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.112116 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.112248 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.112343 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.112595 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.112739 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.112913 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.113209 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.113390 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.113529 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.113654 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.113794 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.113981 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.114110 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.114231 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.114358 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835778-2-iscsi {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.114552 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.114742 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.114886 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.115029 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.115154 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.115275 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.115402 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835778-2-iscsi {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.115629 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.115829 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.116012 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.116159 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.116353 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.116528 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.116679 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.116815 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.116944 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.117167 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.117354 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.117525 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.117655 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.117918 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.118096 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.118234 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.118359 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.118559 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.118751 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.118895 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.119030 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.119160 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.119300 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.119469 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.119610 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.119825 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.119992 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.120125 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.120257 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.120422 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.120553 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.120763 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.120958 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835778-2-iscsi {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.121100 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.121227 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.121437 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835778-2-iscsi {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.121578 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.121752 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.121887 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.122108 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.122239 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.122438 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.122586 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.122709 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.122837 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.123032 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.123168 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.123323 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.123459 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.123652 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.123787 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.123984 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.124115 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.124302 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.124431 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.124624 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.124752 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.124943 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.125079 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.125232 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.125358 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.125554 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.125692 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.125866 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.126001 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.126187 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.126315 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.126500 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.126638 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.126816 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.126944 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.127065 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.127239 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.127373 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.127506 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.127631 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.127751 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.127960 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.128090 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.128281 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.128419 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.128552 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.128753 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.128954 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.129100 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.129432 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.129739 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.130051 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.130177 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.130357 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.130526 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.130651 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.130774 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.130925 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.131053 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.131256 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.131391 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.131554 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.131682 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.131892 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.132036 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.132243 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.132377 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.132500 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.132621 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.132801 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.132931 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.133111 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.133246 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.133406 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.133537 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.133717 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.133844 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.134036 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.134164 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.134345 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.134470 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.134659 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.134784 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.134969 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.135097 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.135283 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.135409 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.135605 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.135734 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.135932 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.136062 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.136245 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.136371 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.136560 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.136683 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.136866 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.136995 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.137179 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.137305 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.137490 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.137627 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.137781 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.137913 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.138036 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.138158 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.138329 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.138471 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.138625 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.138761 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.138955 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.139087 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.139248 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.139390 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.139563 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.139700 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.139840 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.139980 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.140104 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.140235 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.140408 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.140536 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.140722 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.140849 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.141027 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.141162 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.141292 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.141414 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.141617 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.141746 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.141882 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.142012 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.142201 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.142409 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.142542 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.142669 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.142798 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.142927 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.143064 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.143224 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.143350 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.143470 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.143631 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.143760 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.143972 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.144101 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.144329 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.144506 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.144673 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.144811 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.145012 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.145139 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.145325 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.145463 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.145624 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.145753 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.145954 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.146082 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.146261 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.146402 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.146529 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.146658 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.146860 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.146994 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.147156 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.147285 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.147484 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.147610 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.147733 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.147924 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.148079 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.148220 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.148379 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.148508 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.148701 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.148829 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.149005 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.149144 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.149274 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.149396 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.149603 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.149732 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.149901 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.150040 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.150170 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.150298 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.150492 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.150618 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.150778 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.150915 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.151097 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.151225 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.151356 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.151484 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.151675 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.151823 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.151999 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.152139 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.152269 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.152407 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.152605 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.152732 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.152855 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.152975 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.153152 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.153292 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.153429 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.153551 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.153746 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.153881 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.154059 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.154186 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.154316 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.154446 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.154640 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.154769 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.154953 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:07:04.155096 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.155283 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.155414 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.155605 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.155733 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.155973 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.156117 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.156289 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.156417 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.156616 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.156745 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.156946 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.157083 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.157258 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.157401 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.157561 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.157690 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.157874 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.158003 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.158199 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.158327 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.158509 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.158636 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.158814 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.158963 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.159099 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.159229 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.159423 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.159552 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.159738 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.159967 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.160109 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.160243 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.160445 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.160681 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.160824 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.161020 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.161149 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.161335 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.161464 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.161651 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.161788 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.161965 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.162093 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.162292 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.162429 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.162603 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.162755 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.162911 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.163010 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.163223 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.163319 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.163546 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.163691 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.163900 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.164041 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.164217 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.164342 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.164535 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.164669 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.164846 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.164978 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.165153 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.165277 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.165460 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.165586 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.165770 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.165893 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.166084 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.166210 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.166403 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.166535 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.166718 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.166849 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.167028 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.167162 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.167338 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.167470 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.167646 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.167782 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.167979 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.168117 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.168286 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.168411 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.168596 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.168718 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.168909 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.169043 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.169218 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.169341 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.169525 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.169655 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.169835 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.170037 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.170163 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.170290 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.170434 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.170566 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.170739 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.170872 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.171042 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.171174 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.171344 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.171468 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.171644 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.171778 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.171971 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.172106 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.172272 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.172405 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.172590 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.172731 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.172919 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.173050 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.173202 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.173327 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.173522 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.173646 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.173824 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.173947 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.174132 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.174264 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.174439 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.174565 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.174746 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.174871 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.175045 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.175170 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.175351 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.175483 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.175684 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.175859 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.176009 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.176196 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.176337 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.176461 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.176630 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.176756 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.176943 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.177078 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.177256 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.177381 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.177583 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.177696 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.177883 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.178018 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.178193 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.178318 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.178501 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.178743 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.178869 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.179100 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.179329 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.179462 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.179710 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.179973 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.180115 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.180411 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.180541 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.180739 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.180859 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.181066 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.181192 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.181370 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.181566 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.181692 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.181994 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.182153 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.182291 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.182509 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.182621 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.182827 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.182960 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.183141 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.183260 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.183444 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.183570 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.183741 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.183915 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.184058 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.184292 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.184404 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.184661 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.184788 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.184974 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.185110 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.185273 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.185397 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.185573 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.185699 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.185898 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.186036 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.186204 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.186337 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.186506 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.186676 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.186807 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.186992 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.187106 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.187344 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.187426 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.187672 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.187826 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.188034 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.188160 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.188378 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.188647 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.188772 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.188970 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.189104 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.189295 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.189420 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.189628 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.189750 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.189946 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.190072 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.190262 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.190395 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.190578 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.190817 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.190951 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.191283 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.191454 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.191581 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.192038 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.192182 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.192375 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.192499 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.192709 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.192901 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.193026 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.193345 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.193477 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.193656 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.193978 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.194110 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.194324 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.194545 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.194671 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.194970 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.195096 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.195297 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.195423 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.195612 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.195738 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.195954 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.196172 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.196297 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.196579 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.196793 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.196919 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.197195 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.197345 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.197518 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.197659 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.197833 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.197984 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.198154 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.198288 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.198468 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.198603 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.198795 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.198922 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.199110 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.199235 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.199432 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.199569 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.199741 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.199883 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.200205 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.200332 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.200519 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.200807 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.200933 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.201140 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.201257 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.201464 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.201653 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.201763 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.201875 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.202133 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.202440 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.202551 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.202756 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.202993 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.203138 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.203354 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.203475 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.203633 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.203755 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.204094 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.204208 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.204416 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.204726 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.204854 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.205034 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.205147 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.205342 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.205459 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.205646 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.205767 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.205954 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.206067 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.206262 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.206373 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.206573 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.206693 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.206907 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.207079 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.207209 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.207504 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.207615 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.207830 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.207952 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.208143 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.208255 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.210742 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.210892 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211030 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211143 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211251 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211355 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211475 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211593 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211700 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211824 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.211958 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.212065 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.212169 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.212281 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.212386 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.212513 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.212618 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.212722 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.213403 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.213597 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.213718 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.213832 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.213938 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.214059 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.214192 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.214315 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.214429 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.214535 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.214641 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.214764 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.214957 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.215068 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.215172 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.215276 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.215398 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.215527 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.215649 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.215779 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.215963 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.216087 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.216207 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.216341 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.216464 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.216591 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.216720 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.216841 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.216963 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.217092 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.217215 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.217343 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.217465 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.217593 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.217724 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.217857 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.217857 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.218088 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.218209 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.218330 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.218450 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.218450 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.218687 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.218809 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.218809 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.219038 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.219167 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.219291 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.219291 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.219518 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.219640 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.219886 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.220032 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.220291 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.220415 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.220620 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.220941 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.221075 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.221275 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.221400 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.221606 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.221949 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.222084 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.222262 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.222521 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.222669 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.222970 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.223096 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.223281 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.223602 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.223755 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.223934 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.224035 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.224243 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.224353 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.224551 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.224694 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.224864 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.225030 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.225173 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.225480 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.225566 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.225789 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.225892 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.226102 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.226236 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.226417 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.226557 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.226724 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.226870 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.227037 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.227187 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.227343 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.227596 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.227681 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.227950 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.228041 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.228261 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.228354 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.228576 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.228674 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.228964 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.229051 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.229270 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.229576 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.229660 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.229881 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.230133 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.230227 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.230481 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.230684 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.232050 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.232525 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.232612 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.232612 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.232756 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.232842 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.232939 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233030 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233111 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233196 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233274 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233352 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233352 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233573 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233737 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.233981 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.234099 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.234300 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.234428 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.234623 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.234737 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.235030 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.235170 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.235337 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.235634 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.235763 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.235983 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.236219 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.236347 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.236575 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.236768 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.236913 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.237174 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.237298 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.237476 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.237781 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.237906 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.238112 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.238373 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.238503 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.238773 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.238935 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.239063 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.239283 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.239433 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.239583 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.239918 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.240062 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.240225 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.240526 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.240651 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.240826 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.241073 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.241209 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.241426 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.241559 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.241884 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.242008 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.242216 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.242338 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.242592 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.242717 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.242923 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.243067 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.243245 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.243378 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.243527 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.243683 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.243846 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.244045 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.244236 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.244365 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.244547 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.244683 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.244890 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.245015 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.245211 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.245527 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.245651 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.245867 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.246075 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.246203 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.246488 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.246614 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.246802 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.246966 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.247119 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.247375 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.247503 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.247728 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.247951 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.248071 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.248391 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.248554 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.248718 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.248994 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.249121 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.249331 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.249483 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.249645 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.249818 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.249954 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.250137 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.250264 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.250559 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.250693 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.250870 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.251170 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.251297 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.251478 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.251699 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.251845 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.252050 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.252189 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.252372 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.252500 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.252688 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.252815 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.253003 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.253137 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.253313 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.253438 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.253702 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.253832 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.254026 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.254217 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.254343 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.254467 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.254695 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.254823 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.255010 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.255136 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.255331 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.255469 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.255659 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.255792 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.256002 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.256128 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.256321 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.256460 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.256643 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.256770 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.256953 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.257079 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.257274 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.257408 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.257589 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.257722 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.257896 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.258021 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.258206 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.258339 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.258517 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.258641 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.258822 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.258950 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.259137 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.259446 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.259759 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.259996 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.260111 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.260318 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.260439 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.260650 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.260763 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.260977 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.261236 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.261363 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.261587 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.261855 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.261989 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.262212 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.262322 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.262511 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.262632 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.262816 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.262929 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.263123 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.263242 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.263427 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.263548 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.263732 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.263865 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.264125 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.264251 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.264453 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.264580 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.264710 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.264842 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.265023 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.265148 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.265331 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.265464 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.265638 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.265750 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.265944 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.266070 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.266249 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.266363 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.266554 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.266693 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.266854 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.266989 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.267178 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.267288 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.267516 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.267648 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.267859 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.267986 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.268174 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.268286 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.268490 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.268602 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.268801 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.268935 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.269184 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.269359 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.269572 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.269885 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.270020 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.270195 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.270446 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.270580 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.270811 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.270991 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.271129 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.271431 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.271556 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.271739 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.271879 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.272184 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.272321 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.272500 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.272653 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.272814 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.273128 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.273252 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.273438 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.273747 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.273874 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.274057 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.274384 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.274584 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.274727 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.274941 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.275073 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.275272 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.275405 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.275597 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.275723 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.275930 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.276057 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.276254 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.276608 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.276742 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.276985 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.277146 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.277296 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.277488 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.277717 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.277852 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.278034 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.278159 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.278348 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.278474 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.278676 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.278810 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.279004 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.279130 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.279331 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.279462 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.279638 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.279765 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.279982 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.280108 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.280296 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.280421 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.280624 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.280791 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.280950 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.281105 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.281310 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.281450 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.281580 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.281729 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.281864 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.282051 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.282176 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.282374 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.282499 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.282679 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.282813 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.282989 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.283114 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.283300 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.283530 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.283656 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.283886 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.284017 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.284203 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.284339 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.284532 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.284743 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.284957 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.285090 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.285321 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.285639 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.285952 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.286087 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.286273 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.286386 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.286595 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.286707 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.286916 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.287039 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.287229 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.287341 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.287561 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.287694 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.287895 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.288022 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.288215 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.288353 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.288524 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.288649 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.288834 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.288961 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.289138 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.289264 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.289442 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.289553 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.289762 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.289884 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.290064 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.290193 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.290371 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.290498 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.290692 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.290804 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.291068 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.291196 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.291393 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.291519 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.291695 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.291840 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.292041 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.292169 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.292344 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.292482 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.292651 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.292775 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.292959 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.293084 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.293267 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.293403 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.293583 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.293709 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.293887 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.294013 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.294206 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.294340 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.294512 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.294638 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.294816 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.294941 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.295118 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.295236 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.295423 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.295523 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.295759 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.295960 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.296088 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.296178 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.296406 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.296501 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.296732 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.296819 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.297048 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.297134 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.297355 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.297441 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.297667 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.297753 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.297978 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.298066 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.299339 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.299482 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.299572 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.299654 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.299742 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.299845 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.299927 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.300006 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.300006 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.300172 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.300253 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.300338 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.300417 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.300555 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.301652 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.301774 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.301859 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.301939 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.302017 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.302109 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.302191 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.302278 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.302278 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.302422 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.302499 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.302772 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.303684 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.303789 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.303900 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.303993 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.304075 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.304154 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.304248 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.304336 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.304417 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.304617 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.305907 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.305907 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306103 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306188 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306268 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306346 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306425 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306515 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306604 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306685 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306763 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306841 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306921 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.306998 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.307084 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.307164 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.307242 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.307405 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.307506 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.307720 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.307841 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.308121 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.308217 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.308431 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.308524 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.308744 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.308838 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.309056 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.309151 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.309364 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.309500 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.309674 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.309771 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.309986 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.310246 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.310337 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.310584 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.310846 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.310942 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.311171 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.311265 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.311481 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.311585 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.311789 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.311929 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.312121 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.312217 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.312431 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.312535 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.312738 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.312839 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.313042 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.313138 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.313349 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.313455 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.313655 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.313748 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.313960 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.314055 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.314282 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.314385 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.314600 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.314709 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.314949 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.315078 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.315263 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.315395 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.315577 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.315719 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.315912 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.316045 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.316426 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.316599 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.316599 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.316846 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.317019 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.317162 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.317295 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.317415 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.317591 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.317733 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.317985 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.318260 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.318394 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.318577 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.318711 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.318885 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.319029 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.319149 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.319234 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.319578 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.319838 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.320023 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.320188 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.320385 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.320543 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.320712 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.320857 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.321039 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.321216 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.321357 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.321508 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.321686 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.321836 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.322004 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.322112 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.322342 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.322496 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.322639 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.322779 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.322967 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.323090 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.323310 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.323841 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.323991 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.324179 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.324392 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.324484 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.324825 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.324985 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.325156 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.325316 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.325459 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.325600 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.325788 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.325934 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.326118 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.326314 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.326435 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.326525 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.326748 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.326839 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.327070 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.327170 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.327382 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.327476 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.327688 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.327779 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.328042 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.328199 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.328325 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.328514 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.328824 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.329127 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.329414 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.329526 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.329609 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.329743 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.329871 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.330249 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.330407 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.330595 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.330746 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.330891 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.331005 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.331232 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.331341 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.331552 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.331651 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.331902 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.332214 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.332371 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.332532 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.332708 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.332859 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.333019 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.333170 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.333320 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.333480 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.333637 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.333801 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.333932 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.334115 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.334215 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.334424 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.334514 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.334732 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.334823 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.335046 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.335148 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.335341 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.335427 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.335654 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.335752 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.335989 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.336086 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.336298 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.336384 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.336611 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.336838 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.337008 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.337297 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.337416 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.337605 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.337908 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.337994 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.338236 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.338329 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.338555 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.338641 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.338868 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.338953 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.339238 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.339432 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.339540 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.339868 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.340049 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.340175 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.340391 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.340535 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.340714 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.340836 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.341077 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.341171 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.341543 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.341653 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.341863 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.342164 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.342251 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.342463 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.342549 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.342776 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.342863 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.343082 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.343205 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.343403 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.343490 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.343709 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.343820 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.344039 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.344125 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.344380 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.344467 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.344695 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.344781 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.345009 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.345236 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.345325 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.345565 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.345652 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.345885 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.345976 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.346209 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.346296 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.346532 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.346646 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.346842 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.347147 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.347318 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.347580 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.347727 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.347952 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.348096 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.348226 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.348423 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.348560 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.348737 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.348875 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.349046 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.349204 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.349345 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.349484 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.349652 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.349796 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.349939 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.350096 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.350286 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.350415 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.350682 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.350839 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.350981 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.351320 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.351452 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.351635 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.351973 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.352126 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.352268 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.352520 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.352700 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.352862 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.353156 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.353316 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.353472 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.353613 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.353812 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.353945 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.354153 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.354297 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.354471 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.354718 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.354852 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.355096 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.355301 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.355453 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.355710 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.355925 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.356162 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.356428 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.356715 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.356920 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.357406 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.357563 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.357693 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.357842 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.358064 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.358241 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.358393 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.358624 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.358801 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.359044 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.359044 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.359357 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.359439 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.359589 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.359708 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.359929 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.360092 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.360393 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.360544 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.360722 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.360923 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.361029 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.361123 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.361349 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.361483 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.361670 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.361803 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.361981 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.362116 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.362302 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.362450 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.362645 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.362778 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.362979 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.363158 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.363310 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.363542 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.363717 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.363941 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.364119 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.364276 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.364431 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.364580 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.364723 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.364875 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.365033 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.365175 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.365322 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.365454 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.365584 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.365730 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.365851 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.366169 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.366302 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.366427 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.366576 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.366806 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.366962 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.367106 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.367257 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.367388 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.367536 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.367782 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.367885 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.368160 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.368375 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.368462 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.368761 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.368859 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.369068 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.369375 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.369494 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.369695 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.369876 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.370027 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.370189 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.370397 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.370509 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.370582 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.370665 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.370878 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.370973 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.371182 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.371267 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.371484 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.371568 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.371793 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.371933 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.372120 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.372196 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.372426 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.372515 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.372726 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.372809 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.373030 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.373106 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.373330 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.373407 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.373661 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.373736 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.373992 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.374076 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.374305 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.374383 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.374625 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.374708 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.374935 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.375011 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.375322 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.375415 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.375561 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.375638 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.375898 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.375991 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.376265 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.376354 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.376528 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.376780 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.376927 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.377338 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.377436 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.377733 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.377905 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.378070 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.378386 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.378481 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.378787 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.379135 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.379269 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.379457 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.379619 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.379779 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.380114 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.380228 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.380448 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.380565 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.380764 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.380907 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.381167 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.381254 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.381488 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.381797 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.381892 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.382116 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.382389 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.382477 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.382743 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.382900 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.383073 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.383236 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.383404 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.383559 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.383736 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.383902 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.384105 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.384354 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.384461 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.384704 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.385021 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.385129 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.385339 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.385425 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.385738 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.385834 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.386118 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.386223 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.386440 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.386736 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.386845 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.387187 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.387302 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 30 07:07:04.387523 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.387883 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.388219 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.388551 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.388904 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.389222 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.389576 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.389908 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.390225 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.390537 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.390932 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:07:04.391183 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 30 07:07:04.417822 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_db.sqlalchemy.engines [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:07:04.418829 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:07:04.487618 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.context [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcfd7f92-7637-4043-bb9c-f82c3302f9e5(cell1) {{(pid=102738) load_cells /opt/stack/nova/nova/context.py:464}} Mar 30 07:07:04.489052 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.context [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcfd7f92-7637-4043-bb9c-f82c3302f9e5(cell1) {{(pid=102737) load_cells /opt/stack/nova/nova/context.py:464}} Mar 30 07:07:04.491950 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:07:04.493518 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:07:04.494028 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:07:04.494987 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:07:04.496142 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:07:04.496997 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:07:04.497374 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:07:04.500148 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:07:04.509584 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_db.sqlalchemy.engines [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:07:04.512412 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_db.sqlalchemy.engines [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:07:04.515323 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:07:04.518148 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:07:04.696340 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_db.sqlalchemy.engines [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:07:04.701276 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:07:05.208729 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 30 07:07:05.215361 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 30 07:07:05.241777 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: WARNING keystonemiddleware.auth_token [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 30 07:07:05.248480 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: WARNING keystonemiddleware.auth_token [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 30 07:07:05.432235 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 30 07:07:05.437496 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 30 07:07:05.442767 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56304d7339c0 pid: 102737 (default app) Mar 30 07:07:05.444871 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:07:05.446033 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Mar 30 07:07:05.446433 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Mar 30 07:07:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:07:05.500685 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: WARNING keystonemiddleware.auth_token [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 30 07:07:05.510854 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: WARNING keystonemiddleware.auth_token [None req-1474f291-a3bc-4b8e-91fe-d4aa4a96344d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 30 07:07:05.519246 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56304d7339c0 pid: 102738 (default app) Mar 30 07:08:25.159828 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:25.160848 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Mar 30 07:08:25.161214 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:25.601670 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-a89ef7dd-89dc-4959-a150-4b783b65a881 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:25.631267 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-a89ef7dd-89dc-4959-a150-4b783b65a881 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462907 Mar 30 07:08:25.631952 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Mar 30 07:08:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:08:27.995438 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:27.996510 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-07078cad-40e9-49d6-9487-27242a5d5ed8 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Mar 30 07:08:27.996914 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:28.058111 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-4e209138-5f18-473c-89f7-e87f126da1e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:28.076007 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:08:28.076007 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: warnings.warn(msg) Mar 30 07:08:28.110232 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-4e209138-5f18-473c-89f7-e87f126da1e9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107291 Mar 30 07:08:28.114259 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 30 07:08:28.332372 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-9a2dd8bb-bf89-4ddb-972e-3e095bd5f9cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:28.334808 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:08:28.334808 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: warnings.warn(msg) Mar 30 07:08:28.384085 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-9a2dd8bb-bf89-4ddb-972e-3e095bd5f9cd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264639 Mar 30 07:08:28.391736 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Mar 30 07:08:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:08:30.716274 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-4e209138-5f18-473c-89f7-e87f126da1e9 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:30.717296 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-4e209138-5f18-473c-89f7-e87f126da1e9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Mar 30 07:08:30.717721 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:30.829950 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6a270e59-73d2-409f-b8cb-94ded9085904 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "swap": 0, "ram": 512, "vcpus": 1, "disk": 5}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:30.848914 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:08:30.848914 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: warnings.warn(msg) Mar 30 07:08:30.868235 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6a270e59-73d2-409f-b8cb-94ded9085904 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144292 Mar 30 07:08:30.868729 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:08:30.880615 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-0f5924fa-bff6-479c-8e8f-59bf8e82f294 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:30.882108 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:08:30.882108 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: warnings.warn(msg) Mar 30 07:08:30.929311 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-0f5924fa-bff6-479c-8e8f-59bf8e82f294 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052363 Mar 30 07:08:30.930144 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Mar 30 07:08:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:08:33.319558 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6a270e59-73d2-409f-b8cb-94ded9085904 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:33.320662 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6a270e59-73d2-409f-b8cb-94ded9085904 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Mar 30 07:08:33.321028 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:08:33.386429 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-f0d07897-dc91-463b-96aa-befbd572257d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:33.403151 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-f0d07897-dc91-463b-96aa-befbd572257d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075783 Mar 30 07:08:33.403751 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 30 07:08:33.415774 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6c05b2c6-6e0a-4c83-b1d8-4035ce246bb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:33.440347 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6c05b2c6-6e0a-4c83-b1d8-4035ce246bb4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028241 Mar 30 07:08:33.441792 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Mar 30 07:08:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:08:35.787051 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-f0d07897-dc91-463b-96aa-befbd572257d admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:35.788030 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-f0d07897-dc91-463b-96aa-befbd572257d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Mar 30 07:08:35.788612 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:35.849044 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6b431767-281f-4eef-87e7-4169f18639a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:35.868181 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6b431767-281f-4eef-87e7-4169f18639a5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073627 Mar 30 07:08:35.868754 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:08:35.881304 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-49b27f80-62e7-45c2-8e67-1981ba40aeaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:35.903862 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-49b27f80-62e7-45c2-8e67-1981ba40aeaa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026933 Mar 30 07:08:35.904474 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Mar 30 07:08:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:08:38.270954 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6b431767-281f-4eef-87e7-4169f18639a5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:38.271998 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6b431767-281f-4eef-87e7-4169f18639a5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Mar 30 07:08:38.272368 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:38.331845 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-b2477f3b-8e26-4d0e-955c-f3765bebca5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:38.351985 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-b2477f3b-8e26-4d0e-955c-f3765bebca5a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073876 Mar 30 07:08:38.352694 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 30 07:08:38.364792 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-cf06a425-7c5b-493e-b8d1-6df4937d1896 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:38.389010 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-cf06a425-7c5b-493e-b8d1-6df4937d1896 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027947 Mar 30 07:08:38.395852 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Mar 30 07:08:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:08:40.740149 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-b2477f3b-8e26-4d0e-955c-f3765bebca5a admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:40.741171 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-b2477f3b-8e26-4d0e-955c-f3765bebca5a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Mar 30 07:08:40.741541 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:08:40.799595 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-00789f82-15b4-4741-bfb7-2e5136b5f5b6 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:40.823379 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-00789f82-15b4-4741-bfb7-2e5136b5f5b6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075701 Mar 30 07:08:40.824175 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Mar 30 07:08:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:08:43.165598 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-b2477f3b-8e26-4d0e-955c-f3765bebca5a admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:43.166602 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-b2477f3b-8e26-4d0e-955c-f3765bebca5a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Mar 30 07:08:43.166999 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:43.235063 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-a388aa40-ce27-4a64-8749-bf56a4d56355 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:43.253439 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-a388aa40-ce27-4a64-8749-bf56a4d56355 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078018 Mar 30 07:08:43.254016 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:08:43.266686 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-8f7de2ad-6a33-404f-9fde-9de14a8b4db5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:43.291593 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-8f7de2ad-6a33-404f-9fde-9de14a8b4db5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028565 Mar 30 07:08:43.292342 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Mar 30 07:08:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:08:45.639993 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-a388aa40-ce27-4a64-8749-bf56a4d56355 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:45.641205 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-a388aa40-ce27-4a64-8749-bf56a4d56355 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001855 Mar 30 07:08:45.641615 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:45.704249 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-9ec9aa69-364d-4d14-b12f-440966dece07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:45.724518 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-9ec9aa69-364d-4d14-b12f-440966dece07 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076167 Mar 30 07:08:45.725327 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:08:45.737244 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-8854a60d-c480-47c5-bf10-582a326730c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:45.766057 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-8854a60d-c480-47c5-bf10-582a326730c9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032303 Mar 30 07:08:45.766770 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Mar 30 07:08:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:08:48.076480 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-9ec9aa69-364d-4d14-b12f-440966dece07 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:48.077495 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-9ec9aa69-364d-4d14-b12f-440966dece07 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Mar 30 07:08:48.077894 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:48.147866 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-406c627c-5fac-435f-800e-17bec8eea329 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:48.170578 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-406c627c-5fac-435f-800e-17bec8eea329 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086589 Mar 30 07:08:48.171473 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:08:48.184090 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-be8dbfd1-0392-4984-82c7-e90a30da326a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:48.207011 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-be8dbfd1-0392-4984-82c7-e90a30da326a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026613 Mar 30 07:08:48.211946 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Mar 30 07:08:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:08:50.579091 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-406c627c-5fac-435f-800e-17bec8eea329 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:50.580631 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-406c627c-5fac-435f-800e-17bec8eea329 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Mar 30 07:08:50.581258 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:50.648620 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-732e794e-e94a-499e-b6c3-f924ee2d94d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large"}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:50.677306 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-732e794e-e94a-499e-b6c3-f924ee2d94d3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089533 Mar 30 07:08:50.678306 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:08:50.692951 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-a14ef08c-537a-4ed3-8e13-07a3cca05d88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:50.729166 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-a14ef08c-537a-4ed3-8e13-07a3cca05d88 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041993 Mar 30 07:08:50.729916 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Mar 30 07:08:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:08:53.123022 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-732e794e-e94a-499e-b6c3-f924ee2d94d3 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:08:53.124115 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-732e794e-e94a-499e-b6c3-f924ee2d94d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Mar 30 07:08:53.124515 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:08:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:08:53.184368 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6ed389de-e165-447b-9dd2-6b143b73905d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "ram": 16384, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:53.203115 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6ed389de-e165-447b-9dd2-6b143b73905d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.072566 Mar 30 07:08:53.204032 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Mar 30 07:08:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:08:53.216487 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-73f64956-67d9-4552-9130-9baae9dab9f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:08:53.240571 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-73f64956-67d9-4552-9130-9baae9dab9f3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028218 Mar 30 07:08:53.241167 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Mar 30 07:08:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:09:21.256377 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6ed389de-e165-447b-9dd2-6b143b73905d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:21.257386 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6ed389de-e165-447b-9dd2-6b143b73905d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Mar 30 07:09:21.257781 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:09:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:21.321100 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-e9cfb604-4b03-4183-845f-17911afd82fa admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:21.341595 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-e9cfb604-4b03-4183-845f-17911afd82fa admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077912 Mar 30 07:09:21.342134 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Mar 30 07:09:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:09:22.743359 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6ed389de-e165-447b-9dd2-6b143b73905d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:22.744454 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6ed389de-e165-447b-9dd2-6b143b73905d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Mar 30 07:09:22.744862 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:09:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:22.960382 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-4a83055b-5c5d-42e1-a6fb-12f91a4046b8 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:22.966361 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.wsgi [None req-4a83055b-5c5d-42e1-a6fb-12f91a4046b8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 30 07:09:22.966928 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-4a83055b-5c5d-42e1-a6fb-12f91a4046b8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:09:22.967727 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-4a83055b-5c5d-42e1-a6fb-12f91a4046b8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060879 Mar 30 07:09:22.968267 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Mar 30 07:09:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:22.979301 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-7d9e42db-75e7-4eb8-9dd1-8ec83c13b311 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:23.000244 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-7d9e42db-75e7-4eb8-9dd1-8ec83c13b311 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024533 Mar 30 07:09:23.000771 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Mar 30 07:09:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:09:23.010651 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-7267a1f7-2b57-488c-b3af-ff106ecd0c18 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:23.031500 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-7267a1f7-2b57-488c-b3af-ff106ecd0c18 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024395 Mar 30 07:09:23.032055 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Mar 30 07:09:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:09:23.041604 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e9695a36-400b-45b0-b688-e90768572ab9 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:23.047928 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-e9695a36-400b-45b0-b688-e90768572ab9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 30 07:09:23.048500 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e9695a36-400b-45b0-b688-e90768572ab9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:09:23.049292 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e9695a36-400b-45b0-b688-e90768572ab9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011393 Mar 30 07:09:23.049793 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Mar 30 07:09:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:24.301541 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-7267a1f7-2b57-488c-b3af-ff106ecd0c18 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:24.302595 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-7267a1f7-2b57-488c-b3af-ff106ecd0c18 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Mar 30 07:09:24.302987 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:09:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:24.509877 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-683a2e74-0895-4d28-b423-257046f669e7 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:24.515545 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-683a2e74-0895-4d28-b423-257046f669e7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 30 07:09:24.516159 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-683a2e74-0895-4d28-b423-257046f669e7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:09:24.516952 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-683a2e74-0895-4d28-b423-257046f669e7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075588 Mar 30 07:09:24.517466 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Mar 30 07:09:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:24.527217 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-fc6c41b8-3ee6-48cf-9c9d-707403931b82 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:24.541544 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-fc6c41b8-3ee6-48cf-9c9d-707403931b82 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017940 Mar 30 07:09:24.542108 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Mar 30 07:09:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:09:24.551593 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-12b172e2-0ca8-4016-9823-90a3eabbc07d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:24.565216 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-12b172e2-0ca8-4016-9823-90a3eabbc07d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017143 Mar 30 07:09:24.565839 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Mar 30 07:09:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:09:24.575316 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-22291199-1261-4d59-8027-96a94b855adf admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:24.580681 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.wsgi [None req-22291199-1261-4d59-8027-96a94b855adf admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 30 07:09:24.581237 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-22291199-1261-4d59-8027-96a94b855adf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:09:24.582408 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-22291199-1261-4d59-8027-96a94b855adf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010520 Mar 30 07:09:24.582917 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Mar 30 07:09:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:25.841536 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-12b172e2-0ca8-4016-9823-90a3eabbc07d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:25.842579 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-12b172e2-0ca8-4016-9823-90a3eabbc07d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Mar 30 07:09:25.842986 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:09:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:26.042821 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-0104ce3b-d00a-4b38-884a-658155feebc1 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:26.048726 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.wsgi [None req-0104ce3b-d00a-4b38-884a-658155feebc1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 30 07:09:26.049202 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-0104ce3b-d00a-4b38-884a-658155feebc1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:09:26.050029 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-0104ce3b-d00a-4b38-884a-658155feebc1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.071983 Mar 30 07:09:26.050579 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Mar 30 07:09:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:26.065943 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-0f9609f7-a5e2-4c3d-83eb-2fa96cea1fc7 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:26.079517 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-0f9609f7-a5e2-4c3d-83eb-2fa96cea1fc7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019612 Mar 30 07:09:26.080077 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Mar 30 07:09:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:09:26.090035 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:26.103521 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017435 Mar 30 07:09:26.104083 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Mar 30 07:09:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:09:26.113823 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-9893beb7-b977-4836-b58b-557ac9b690b8 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:26.118959 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-9893beb7-b977-4836-b58b-557ac9b690b8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 30 07:09:26.119517 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-9893beb7-b977-4836-b58b-557ac9b690b8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:09:26.120342 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-9893beb7-b977-4836-b58b-557ac9b690b8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010181 Mar 30 07:09:26.120824 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Mar 30 07:09:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:27.390731 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:27.391745 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Mar 30 07:09:27.392200 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:09:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:27.595776 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e7f08ef3-c814-4116-a671-2544a67ffe0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:09:27.621816 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e7f08ef3-c814-4116-a671-2544a67ffe0a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.093054 Mar 30 07:09:27.622350 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Mar 30 07:09:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:09:28.914235 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:28.915853 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Mar 30 07:09:28.916259 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:29.122189 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-937b02ac-8b5a-448c-b483-967d88a980cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:09:29.141188 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-937b02ac-8b5a-448c-b483-967d88a980cc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073077 Mar 30 07:09:29.141732 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Mar 30 07:09:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:09:30.389767 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:30.390761 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Mar 30 07:09:30.391145 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:30.597922 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-cfc1eb00-8805-496c-82cb-92f949900d71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:09:30.615548 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-cfc1eb00-8805-496c-82cb-92f949900d71 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.089266 Mar 30 07:09:30.616128 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Mar 30 07:09:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:09:31.903984 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:31.905537 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Mar 30 07:09:31.906091 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:32.097654 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-7ef0b1cd-7673-42d6-8a17-1bde244de715 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:09:32.117959 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-7ef0b1cd-7673-42d6-8a17-1bde244de715 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073877 Mar 30 07:09:32.118423 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Mar 30 07:09:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:09:33.410838 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:33.411908 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Mar 30 07:09:33.412305 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:09:33.623421 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-275d54f1-cb91-4b03-9ded-172376d8784f admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:09:33.642715 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-275d54f1-cb91-4b03-9ded-172376d8784f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.087662 Mar 30 07:09:33.643517 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Mar 30 07:09:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:10:24.523765 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:10:24.524795 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-de0ca47b-661a-4bbb-97a6-b01062ffbe2c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Mar 30 07:10:24.525190 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Wed Mar 30 07:10:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:10:24.584580 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-25ede09a-0aba-4727-8b35-e7850c39e83c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:10:24.604086 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-25ede09a-0aba-4727-8b35-e7850c39e83c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073042 Mar 30 07:10:24.604602 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Mar 30 07:10:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:10:24.627378 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-10505327-3ed7-47b9-acda-66d44cf760ad admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:10:24.635575 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-10505327-3ed7-47b9-acda-66d44cf760ad admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011833 Mar 30 07:10:24.636175 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Mar 30 07:10:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:10:24.650563 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-4008e269-908d-4a6c-a18a-597c8d755611 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:10:24.661839 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-4008e269-908d-4a6c-a18a-597c8d755611 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017560 Mar 30 07:10:24.662368 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Mar 30 07:10:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:10:24.676674 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-64dc0b95-23c3-4749-8faa-1fd576d551c1 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:10:24.687613 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-64dc0b95-23c3-4749-8faa-1fd576d551c1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017062 Mar 30 07:10:24.688385 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Mar 30 07:10:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:10:24.700402 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:10:24.708385 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011605 Mar 30 07:10:24.708902 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Mar 30 07:10:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:11:57.218432 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-3b919a80-df32-45a3-a24f-7dc2bd1227c5 tempest-verify_tempest_config-1069459704 tempest-verify_tempest_config-1069459704-project] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:11:57.220428 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-3b919a80-df32-45a3-a24f-7dc2bd1227c5 tempest-verify_tempest_config-1069459704 tempest-verify_tempest_config-1069459704-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.124424 Mar 30 07:11:57.220996 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Mar 30 07:11:57 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:13:28.640564 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:13:28.641602 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001955 Mar 30 07:13:28.641971 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:13:28.929705 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-51c9c81c-eab4-4768-80a9-dbfa37f4d30d admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:13:28.931272 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:13:28.931272 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: warnings.warn(msg) Mar 30 07:13:28.932503 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-51c9c81c-eab4-4768-80a9-dbfa37f4d30d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:13:28.932933 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-51c9c81c-eab4-4768-80a9-dbfa37f4d30d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:13:28.933703 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-51c9c81c-eab4-4768-80a9-dbfa37f4d30d admin admin] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:13:28.934146 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-51c9c81c-eab4-4768-80a9-dbfa37f4d30d admin admin] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:13:28.971747 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-51c9c81c-eab4-4768-80a9-dbfa37f4d30d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.185285 Mar 30 07:13:28.972348 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 35/71] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Mar 30 07:13:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:13:30.254579 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:13:30.255579 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Mar 30 07:13:30.256004 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 37/72] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:13:30.456140 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-c03da465-ea35-42e3-8f18-fda50fe2b33d admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:13:30.457308 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:13:30.457308 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: warnings.warn(msg) Mar 30 07:13:30.458502 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-c03da465-ea35-42e3-8f18-fda50fe2b33d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:13:30.458939 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-c03da465-ea35-42e3-8f18-fda50fe2b33d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:13:30.459715 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-c03da465-ea35-42e3-8f18-fda50fe2b33d admin admin] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:13:30.460170 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-c03da465-ea35-42e3-8f18-fda50fe2b33d admin admin] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:13:30.480082 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-c03da465-ea35-42e3-8f18-fda50fe2b33d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082363 Mar 30 07:13:30.480640 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 36/73] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Mar 30 07:13:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:13:42.224270 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:13:42.225413 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Mar 30 07:13:42.225803 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 38/74] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:13:42.429874 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-c9eaaea0-7531-4a7a-a734-95f769c2ae32 admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:13:42.430980 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:13:42.430980 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: warnings.warn(msg) Mar 30 07:13:42.432210 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-c9eaaea0-7531-4a7a-a734-95f769c2ae32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:13:42.432646 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-c9eaaea0-7531-4a7a-a734-95f769c2ae32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:13:42.433432 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-c9eaaea0-7531-4a7a-a734-95f769c2ae32 admin admin] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:13:42.433857 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-c9eaaea0-7531-4a7a-a734-95f769c2ae32 admin admin] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:13:42.458191 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-c9eaaea0-7531-4a7a-a734-95f769c2ae32 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095315 Mar 30 07:13:42.458735 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 37/75] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Mar 30 07:13:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:13:43.721842 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:13:43.722868 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6fa00823-6cfa-4910-b7f9-c4de18fbd18c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Mar 30 07:13:43.723238 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 39/76] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Mar 30 07:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:13:43.913270 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG nova.api.openstack.wsgi [None req-b19c1ef7-bf2e-4d50-aa58-29090a8aa47d admin admin] Calling method '>' {{(pid=102738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:13:43.914433 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:13:43.914433 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: warnings.warn(msg) Mar 30 07:13:43.915629 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-b19c1ef7-bf2e-4d50-aa58-29090a8aa47d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:13:43.916082 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-b19c1ef7-bf2e-4d50-aa58-29090a8aa47d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:13:43.916853 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-b19c1ef7-bf2e-4d50-aa58-29090a8aa47d admin admin] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:13:43.917266 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: DEBUG oslo_concurrency.lockutils [None req-b19c1ef7-bf2e-4d50-aa58-29090a8aa47d admin admin] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:13:43.938190 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: INFO nova.api.openstack.requestlog [None req-b19c1ef7-bf2e-4d50-aa58-29090a8aa47d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076793 Mar 30 07:13:43.938663 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: [pid: 102738|app: 0|req: 38/77] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Mar 30 07:13:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:14:40.723360 dv-cinder-835778-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 30 07:14:40.724069 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: Wed Mar 30 07:14:40 2022 - graceful shutdown triggered... Mar 30 07:14:40.724518 dv-cinder-835778-2-iscsi devstack@n-api.service[102737]: Gracefully killing worker 1 (pid: 102737)... Mar 30 07:14:40.725137 dv-cinder-835778-2-iscsi devstack@n-api.service[102738]: Gracefully killing worker 2 (pid: 102738)... Mar 30 07:14:41.725253 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: worker 1 buried after 1 seconds Mar 30 07:14:41.725253 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: worker 2 buried after 1 seconds Mar 30 07:14:41.725253 dv-cinder-835778-2-iscsi devstack@n-api.service[102736]: goodbye to uWSGI. Mar 30 07:14:41.727674 dv-cinder-835778-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 30 07:14:41.728673 dv-cinder-835778-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 30 07:14:41.733211 dv-cinder-835778-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 30 07:14:41.750337 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Mar 30 07:14:41 2022] *** Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: nodename: dv-cinder-835778-2-iscsi Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: machine: x86_64 Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: clock source: unix Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: pcre jit disabled Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: detected number of CPU cores: 4 Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: current working directory: / Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: detected binary path: /usr/bin/uwsgi-core Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: your processes number limit is 47680 Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: your memory page size is 4096 bytes Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: detected max file descriptor number: 2048 Mar 30 07:14:41.773635 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: lock engine: pthread robust mutexes Mar 30 07:14:41.774615 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: thunder lock: enabled Mar 30 07:14:41.774615 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 30 07:14:41.774615 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 30 07:14:41.819442 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: Python main interpreter initialized at 0x556304f429c0 Mar 30 07:14:41.819442 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: python threads support enabled Mar 30 07:14:41.819442 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: your server socket listen backlog is limited to 100 connections Mar 30 07:14:41.819442 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: your mercy for graceful operations on workers is 90 seconds Mar 30 07:14:41.819873 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: mapped 403077 bytes (393 KB) for 2 cores Mar 30 07:14:41.819873 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: *** Operational MODE: preforking *** Mar 30 07:14:41.820098 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: *** uWSGI is running in multiple interpreter mode *** Mar 30 07:14:41.820098 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: spawned uWSGI master process (pid: 117046) Mar 30 07:14:41.820299 dv-cinder-835778-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 30 07:14:41.822009 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: spawned uWSGI worker 1 (pid: 117062, cores: 1) Mar 30 07:14:41.822009 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: spawned uWSGI worker 2 (pid: 117063, cores: 1) Mar 30 07:14:41.822301 dv-cinder-835778-2-iscsi devstack@n-api.service[117046]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 30 07:14:42.994046 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 30 07:14:42.996260 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 30 07:14:43.906115 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:14:43.906115 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: from cryptography.utils import int_from_bytes Mar 30 07:14:43.906480 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:14:43.906480 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: from cryptography.utils import int_from_bytes Mar 30 07:14:43.907089 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:14:43.907089 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: from cryptography.utils import int_from_bytes Mar 30 07:14:43.907373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:14:43.907373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: from cryptography.utils import int_from_bytes Mar 30 07:14:46.298491 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 30 07:14:46.299128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 30 07:14:46.299128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 30 07:14:46.299594 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 30 07:14:46.299676 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 30 07:14:46.299757 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 30 07:14:46.300078 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 30 07:14:46.300184 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 30 07:14:46.300260 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 30 07:14:46.300336 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 30 07:14:46.300406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.300474 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.300575 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.300655 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.300872 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.300965 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.301166 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.301275 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.301496 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.301600 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.301804 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.301911 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.302126 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.302238 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.302451 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.302555 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.302776 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.302881 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.303041 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.303156 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.303355 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.303522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.303683 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835778-2-iscsi {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.303883 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835778-2-iscsi {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.304040 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.304194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.304340 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.304488 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.304652 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.304793 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.304995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.305144 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.305283 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.305427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.305572 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.305718 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.305870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.306015 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.306310 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.306488 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.307702 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.307702 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.308198 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.308401 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.308618 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.308618 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.309019 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.309019 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.309427 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.309640 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.309847 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.310067 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.310296 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.310513 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.310720 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.310926 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.311132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.311338 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.311559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.311559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.311972 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835778-2-iscsi {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.312178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835778-2-iscsi {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.312391 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.312740 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.312972 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.313172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.313352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.313552 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.313711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.313861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.314051 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.314196 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.314346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.314498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.315322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.315487 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.315629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.315779 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.315983 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.316137 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.316291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.316436 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.316575 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.316712 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.316851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.317003 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.317153 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.317298 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.317437 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.317575 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.317734 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.317884 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.317884 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.318157 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.318305 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.318443 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.318623 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.318803 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.318945 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.319083 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.319228 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.319374 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.319522 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.319673 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.319832 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.319996 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.320147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.320285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.320431 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.320581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.320730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.320879 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.321018 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.321323 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.321484 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.321634 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.321774 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.321920 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.322073 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.322213 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.322361 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.322510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.322656 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.322805 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.322955 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.323110 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.323258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.323410 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.323554 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.323702 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.323879 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.324030 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.324177 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.324324 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.324469 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.324614 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.325449 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.325659 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.325852 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.325992 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.326137 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.326288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.326437 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.326584 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.326729 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.326875 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.327030 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.327185 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.327331 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.327482 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.327621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.327778 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.327948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.328114 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.328259 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.328417 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.328565 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.328714 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.328868 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.329014 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.329162 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.329309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.329454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.329600 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.329764 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.329921 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.330065 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.330217 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.330364 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.330512 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.330650 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.330793 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.330941 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.331079 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.331223 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.331470 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.331634 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.331780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.331980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.332127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.332272 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.332418 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.332563 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.332708 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.332857 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.333005 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.333208 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.333359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.333498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.333645 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.333791 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.333938 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.334083 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.334236 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.334381 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.334528 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.334672 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.334818 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.335618 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.335774 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.336022 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.336174 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.336329 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.336475 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.336631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.336772 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.336923 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.337062 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.337199 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.337345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.337501 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.337639 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.340344 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.340521 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.340685 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.340854 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.341013 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.341169 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.341322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.341488 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.341711 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.341863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.342017 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.342163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.342310 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.342591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.342749 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.342896 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.343073 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.343317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.343480 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.343628 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.343776 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.343956 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.344104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.344255 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.344400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.344546 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.344692 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.344839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.344988 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.345143 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.345900 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.346057 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.346198 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.346397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.346542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.346688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.346835 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.347009 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.347159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.347314 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.347454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.347622 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.347761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.347959 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.348116 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.348263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.348439 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.348581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.348727 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.348873 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.349020 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.349168 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.349313 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.349460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.349616 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.349769 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.349924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.350063 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.350236 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.350379 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.350518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.350665 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:14:46.350894 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.351041 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.351187 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.351333 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.351473 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.351629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.351879 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.352037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.352185 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.352333 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.352482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.352636 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.352774 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.352918 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.353056 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.353200 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.353346 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.353571 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.353713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.353851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.354000 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.354146 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.354296 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.354443 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.354581 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.354720 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.354857 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.355002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.355149 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.355296 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.356061 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.356061 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.356348 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.356488 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.356633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.356788 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.357372 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.357516 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.357653 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.357800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.357946 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.358093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.358302 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.358452 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.358591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.358728 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.358872 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.359032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.359178 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.359323 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.359469 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.359607 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.359749 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.360038 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.360187 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.360343 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.360490 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.360628 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.360779 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.360998 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.361145 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.361285 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.361431 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.361577 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.361726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.361894 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.362124 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.362267 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.362417 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.362555 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.362702 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.362848 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.362987 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.363133 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.363279 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.363418 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.363569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.363708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.363869 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.364014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.364164 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.364313 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.364460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.364606 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.364751 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.364889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.365036 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.365184 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.365330 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.365474 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.366059 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.366406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.366632 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.366798 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.366798 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.367069 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.367220 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.367359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.367496 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.367643 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.367643 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.367969 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.368119 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.368268 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.368415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.368553 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.368701 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.368839 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.368976 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.369124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.369271 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.369418 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.369557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.369701 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.369849 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.369987 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.369987 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.370270 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.370409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.370555 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.370693 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.370831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.370983 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.371121 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.371268 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.371486 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.371631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.371778 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.371950 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.372108 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.372324 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.372503 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.372657 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.372810 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.372949 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.373095 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.373234 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.373380 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.373527 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.373674 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.373813 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.373951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.374088 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.374226 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.374373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.374520 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.374660 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.374804 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.374949 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.375086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.375232 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.375380 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.375518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.375657 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.376258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.376584 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.376741 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.376906 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.377115 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.377264 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.377412 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.377558 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.377712 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.377859 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.377997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.378136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.378275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.378421 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.378573 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.378720 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.378887 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.379140 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.379297 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.379452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.379591 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.379745 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.379918 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.380068 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.380213 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.380359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.380498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.380644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.380803 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.380943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.381088 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.381289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.381429 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.381674 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.381828 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.381969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.382115 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.382337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.382545 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.382689 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.382836 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.382996 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.383143 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.383289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.383436 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.383582 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.383721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.383905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.383905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.384191 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.384330 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.384468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.384613 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.384752 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.384913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.385052 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.385190 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.385334 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.385480 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.385631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.385782 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.386312 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.386473 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.386835 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.386982 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.387132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.387272 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.387430 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.387430 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.387719 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.387955 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.388155 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.388311 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.388450 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.388588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.388733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.388879 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.389032 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.389171 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.389317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.389474 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.389613 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.389759 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.389912 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.390059 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.390197 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.390346 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.390494 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.390633 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.390780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.390918 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.391062 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.391207 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.391367 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.391520 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.391665 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.391819 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.391975 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.392123 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.392261 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.392409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.392564 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.392780 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.392994 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.393136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.393284 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.393432 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.393571 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.393708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.393854 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.394007 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.394160 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.394320 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.394474 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.394626 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.394777 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.394928 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.395080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.395245 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.395391 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.395536 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.395686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.395881 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.396457 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.396617 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.396782 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.397121 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.397276 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.397431 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.397586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.397586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.397883 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.397883 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.397883 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.398307 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.398460 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.398460 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.398736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.398888 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.398888 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.399179 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.399333 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.399477 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.399627 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.399794 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.399962 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.400117 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.400270 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.400422 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.400567 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.400711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.400856 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.401014 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.401159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.401302 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.401454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.401615 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.401775 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.401775 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.402063 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.402214 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.402358 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.402502 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.402656 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.402894 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.403046 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.403192 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.403336 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.403481 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.403643 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.403839 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.404003 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.404149 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.404293 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.404444 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.404772 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.404929 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.405086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.405231 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.405375 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.405528 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.405688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.405844 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.405844 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.406146 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.406146 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.406859 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.407203 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.407358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.407358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.407654 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.407799 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.408024 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.408172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.408317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.408482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.408635 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.408788 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.408943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.409095 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.409242 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.409386 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.409530 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.409682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.409845 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.409994 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.410147 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.410292 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.410448 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.410592 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.410751 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.410904 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.411056 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.411210 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.411356 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.411580 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.411736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.412091 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.412245 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.412392 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.412563 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.412718 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.412882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.413201 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.413367 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.413521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.413667 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.413826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.413972 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.414116 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.414273 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.414273 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.414567 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.414732 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.414878 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.414878 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.415166 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.415311 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.415466 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.415614 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.415767 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.415965 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.416122 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.416267 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.416817 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.416974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.416974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.417460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.417627 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.417627 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.417913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.418068 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.418221 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.418380 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.418525 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.418677 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.418829 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.418975 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.419130 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.419289 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.419494 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.419697 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.419881 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.420040 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.420186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.420340 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.420499 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.420653 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.420653 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.420950 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.421103 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.421259 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.421405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.421559 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.421714 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.421860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.422012 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.422167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.422320 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.422465 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.422624 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.422780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.422931 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.423084 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.423322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.423522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.423679 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.423901 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.424055 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.424211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.424370 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.424523 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.424682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.424835 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.424980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.425125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.425278 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.425448 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.425448 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.425724 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.425868 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.426014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.426014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.426309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.426309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.427713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.427713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.428038 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.428186 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.428351 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.428506 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.428651 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.428805 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.428958 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.429113 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.429265 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.429418 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.429563 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.429713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.429863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.430018 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.430164 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.430321 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.430490 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.431528 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.432386 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.432548 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.432696 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.432845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.432990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.433198 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.433441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.433593 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.433738 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.433894 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.433894 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.434183 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.434339 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.434483 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.434627 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.434770 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.434921 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.435094 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.435249 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.435403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.435555 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.435711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.435885 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.436044 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.436191 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.436334 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.436479 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.436784 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.437202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.437365 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.437530 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.437530 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.438002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.438002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.438300 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.438300 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.438586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.438586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.438860 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.439639 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.439847 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.440012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.440158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.440158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.440456 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.440628 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.440774 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.440925 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.441078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.441231 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.441377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.441521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.441666 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.441666 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.441956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.442185 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.442340 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.442340 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.442636 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.442790 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.442949 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.443112 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.443317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.443559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.443742 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.443926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.444088 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.444235 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.444379 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.444523 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.444668 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.444831 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.444990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.445136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.445281 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.445424 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.445424 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.445719 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.445883 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.446037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.446184 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.446329 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.446523 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.446681 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.447298 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.447457 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.447612 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.447782 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.448140 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.448303 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.448502 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.448662 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.448662 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.448954 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.449108 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.449263 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.449427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.449581 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.449735 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.449881 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.450035 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.450194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.450381 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.450530 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.450738 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.450894 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.451257 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.451458 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.451611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.451769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.452076 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.452237 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.452237 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.452531 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.452685 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.452825 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.452950 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.453059 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.453182 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.453292 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.453407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.453539 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.453735 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.453866 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.453992 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.454101 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.454216 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.454331 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.454437 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.454552 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.454664 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.454778 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.454884 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455016 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455201 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455636 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455750 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455854 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.455939 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456022 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456103 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456197 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456291 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456375 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456465 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456548 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456764 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456867 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.456990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.457077 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.457478 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.457581 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.457680 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.457766 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.457766 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.457925 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.458050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.458278 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.458460 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.458573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.458659 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.458750 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.458833 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.458914 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459089 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459089 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459239 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459320 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459507 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459604 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459696 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459789 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.459916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460018 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460104 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460187 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460277 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460369 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460550 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460550 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460869 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.460952 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461043 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461133 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461224 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461307 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461390 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461483 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461583 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461666 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461749 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461749 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.461913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462004 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462095 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462268 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462359 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462457 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462555 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462646 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462729 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462892 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.462980 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463072 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463309 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463309 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463457 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463553 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463860 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.463949 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464049 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464140 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464231 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464314 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464395 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464486 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464577 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464669 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464758 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464842 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.464931 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465013 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465270 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465354 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465444 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465528 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465620 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465712 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465804 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465887 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.465969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466051 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466147 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466289 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466447 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466549 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466549 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466820 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.466985 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.467072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.467072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.467244 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.467613 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.467708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.467708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.467917 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.467917 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.468078 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.468171 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.468271 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.468352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.468423 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.468423 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.468582 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.468672 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469027 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469222 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469317 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469401 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469490 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469576 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469668 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469759 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469851 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.469944 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470027 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470116 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470212 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470395 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470647 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470738 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470829 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.470922 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471013 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471097 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471179 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471268 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471443 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471525 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471607 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471695 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471790 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.471942 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472043 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472043 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472205 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472288 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472384 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472549 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472730 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472823 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.472916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473001 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473090 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473174 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473262 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473352 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473443 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473539 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473795 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473886 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.473970 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474052 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474135 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474223 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474317 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474413 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474584 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474666 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474747 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.474840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475195 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475277 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475366 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475466 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475550 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475720 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475868 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.475978 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476070 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476159 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476245 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476327 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476505 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476589 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476671 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476752 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.476916 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.477005 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.477096 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.477179 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.477267 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.477357 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.477700 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.477806 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.477900 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478006 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478164 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478262 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478357 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478512 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478663 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478929 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.478929 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.479240 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.479364 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.479474 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.479606 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.479723 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.479859 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.479988 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.480104 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.480222 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.480337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.480447 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.480560 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.480687 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.480796 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.480913 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.481136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.481290 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.481436 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.481600 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.481757 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.482366 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.482605 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.482768 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.483046 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.483206 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.483380 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.483573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.483774 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.483973 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.484130 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.484310 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.484473 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.484635 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.484777 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.484964 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.485112 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.485281 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.485437 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.485602 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.485764 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.485931 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.486095 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.486245 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.486420 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.486568 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.486742 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.486886 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.487067 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.487233 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.487401 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.487524 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.487885 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.488028 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.488183 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.488329 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.488430 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.488673 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.488766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.488995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.489254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.489354 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.489606 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.489735 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.489917 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.490008 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.490242 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.490341 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.490564 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.490654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.490875 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.490971 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.491193 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.491290 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.491508 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.491605 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.491855 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.491960 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.492162 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.492263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.492476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.492575 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.492789 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.492925 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.493104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.493219 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.493420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.493512 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.493733 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.493837 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.494050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.494140 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.494366 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.494455 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.494685 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.494783 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.495007 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.495097 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.495329 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.495417 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.495644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.495733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.495993 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.496096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.496310 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.496398 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.496633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.496829 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.496953 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.497149 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.497271 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.497511 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.497640 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.497972 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.498166 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.498258 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.498603 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.498702 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.498933 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.499022 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.499250 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.499387 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.499563 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.499664 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.499897 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.499992 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.500212 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.500310 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.500527 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.500625 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.500834 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.500924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.501162 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.501250 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.501474 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.501565 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.501783 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.501872 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.502106 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.502305 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.502408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.502633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.502948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.503066 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.503303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.503408 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.503626 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.503721 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.503986 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.504081 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.504312 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.504405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.504631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.504723 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.504946 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.505046 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.505257 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.505362 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.505575 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.505666 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.505887 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.505992 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.506198 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.506309 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.506513 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.506606 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.506821 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.506921 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.507132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.507239 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.507450 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.507549 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.507765 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.507914 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.508201 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.508401 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.508504 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.508705 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.508796 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.509034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.509140 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.509345 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.509465 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.509658 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.509821 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.509960 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.510122 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.510260 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.510393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.510557 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.510691 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.510866 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.511012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.511173 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.511315 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.511479 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.511620 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.511793 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.511930 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.512123 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.512220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.512430 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.512518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.512736 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.512832 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.513050 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.513177 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.513590 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.513690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.513912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.514072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.514269 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.514392 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.514599 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.514727 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.514911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.515041 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.515220 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.515351 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.515540 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.515664 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.515885 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.516004 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.516217 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.516332 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.516533 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.516645 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.516848 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.516963 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.517201 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.517312 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.517515 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.517630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.517828 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.518045 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.518350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.518440 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.518530 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.518692 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.518801 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.519021 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.519114 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.519341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.519442 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.519651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.519765 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.519997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.520129 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.520308 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.520469 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.520637 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.520772 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.520948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.521087 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.521261 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.521408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.521574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.521715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.521887 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.522020 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.522202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.522414 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.522560 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.522704 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.522841 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.522977 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.523123 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.523376 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.523517 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.523710 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.523880 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.524055 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.524158 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.524369 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.524459 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.524686 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.524777 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.525008 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.525104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.525324 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.525414 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.525634 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.525722 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.525957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.526054 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.526272 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.526361 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.526581 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.526670 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.526892 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.526989 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.527202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.527290 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.527512 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.527607 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.527875 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.527984 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.528211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.528338 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.528486 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.528574 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.528965 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.529393 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.529525 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.529843 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.529961 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.530175 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.530282 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.530502 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.530590 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.530834 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.530922 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.531158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.531256 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.531480 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.531567 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.531817 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.531920 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.532148 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.532236 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.532459 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.532547 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.532775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.532873 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.533092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.533181 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.533408 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.533501 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.533730 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.533830 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.534066 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.534156 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.534373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.534460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.534681 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.534777 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.534986 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.535108 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.535301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.535427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.535625 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.535752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.535968 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.536104 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.536284 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.536424 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.536594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.536749 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.536912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.537078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.537222 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.537393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.537528 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.537719 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.537837 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.538036 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.538147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.538375 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.538537 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.538726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.538825 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.539040 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.539137 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.539336 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.539432 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.539641 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.539730 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.539969 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.540088 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.540277 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.540366 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.540588 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.540684 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.540890 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.540985 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.541200 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.541291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.541506 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.541636 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.541808 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.541905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.542113 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.542202 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.542418 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.542520 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.542749 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.542893 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.543071 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.543215 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.543393 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.543531 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.543706 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.543867 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.544055 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.544181 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.544393 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.544587 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.544719 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.545046 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.545146 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.545366 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.545458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.545682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.545782 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.546019 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.546111 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.546340 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.546440 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.546651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.546752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.546958 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.547055 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.547266 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.547367 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.547576 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.547687 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.547914 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.548026 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.548247 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.548340 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.548578 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.548791 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.548924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.549022 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.549200 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.549495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.549812 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.549906 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.549999 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.550083 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.550166 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.550256 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.550441 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.550537 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.550773 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.550863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.551089 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.551185 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.551404 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.551493 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.551721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.551841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.552061 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.552234 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.552377 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.552475 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.552689 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.552777 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.553003 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.553106 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.553317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.553413 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.553675 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.553783 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.553956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.554056 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.554282 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.554371 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.554593 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.554690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.554923 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.555021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.555243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.555339 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.555569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.555659 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.555908 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.556012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.556224 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.556313 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.556529 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.556624 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.556773 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 30 07:14:46.556865 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.557166 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.557487 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.557803 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.558126 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.558447 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.558771 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.559102 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.559432 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.559763 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.560285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.560817 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.561144 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.561495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.561831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.562155 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.562476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.562790 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:14:46.563037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 30 07:14:46.580325 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_db.sqlalchemy.engines [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:14:46.585794 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_db.sqlalchemy.engines [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:14:46.644053 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.context [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcfd7f92-7637-4043-bb9c-f82c3302f9e5(cell1) {{(pid=117062) load_cells /opt/stack/nova/nova/context.py:464}} Mar 30 07:14:46.648449 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:14:46.650039 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:14:46.650836 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:14:46.652821 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:14:46.655054 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.context [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcfd7f92-7637-4043-bb9c-f82c3302f9e5(cell1) {{(pid=117063) load_cells /opt/stack/nova/nova/context.py:464}} Mar 30 07:14:46.659383 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:14:46.660990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:14:46.661829 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:14:46.663792 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_db.sqlalchemy.engines [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:14:46.663968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:14:46.664654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_db.sqlalchemy.engines [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:14:46.674820 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_db.sqlalchemy.engines [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:14:46.676004 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_db.sqlalchemy.engines [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:14:46.820070 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_db.sqlalchemy.engines [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:14:46.830680 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_db.sqlalchemy.engines [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:14:47.262585 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: WARNING keystonemiddleware.auth_token [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 30 07:14:47.266912 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: WARNING keystonemiddleware.auth_token [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 30 07:14:47.269384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: WARNING keystonemiddleware.auth_token [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 30 07:14:47.273394 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: WARNING keystonemiddleware.auth_token [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 30 07:14:47.491173 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: WARNING keystonemiddleware.auth_token [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 30 07:14:47.492617 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: WARNING keystonemiddleware.auth_token [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 30 07:14:47.496330 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: WARNING keystonemiddleware.auth_token [None req-cb835ddb-913b-4e7a-a221-27758f3398f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 30 07:14:47.497871 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: WARNING keystonemiddleware.auth_token [None req-ae736a19-dcf1-4dd7-b30d-3e82b1b8aa4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 30 07:14:47.501974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556304f429c0 pid: 117062 (default app) Mar 30 07:14:47.503203 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556304f429c0 pid: 117063 (default app) Mar 30 07:15:31.223242 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1022261505", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "networks": [{"uuid": "7f455514-9fa4-4e1a-8166-63ab0dc42e80"}]}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:31.812141 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-116207ce-9ea3-41f5-87f0-f647c1d93026 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154e5df3a0>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:31.982586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] validate_networks() for [('7f455514-9fa4-4e1a-8166-63ab0dc42e80', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:15:32.371237 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-116207ce-9ea3-41f5-87f0-f647c1d93026 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d2343c60-74a2-4739-95d8-c6e7b611da9a" status: 200 len: 351 microversion: 2.1 time: 1.082916 Mar 30 07:15:32.371939 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:15:31 2022] GET /compute/v2.1/os-volumes/d2343c60-74a2-4739-95d8-c6e7b611da9a => generated 351 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:34.159656 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:15:34.160700 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:15:34.161332 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:15:34.162033 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:15:34.162596 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:15:34.186166 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:34.186625 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:34.187436 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:34.193519 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:34.274703 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Getting quotas for project ad704701fcba49e5adc45e451291ef71. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:34.289476 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Getting quotas for user d766a95dfb444e6c95d1111d933cdd83 and project ad704701fcba49e5adc45e451291ef71. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:34.326015 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:15:34.329214 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:15:34.422277 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0eb4ee18-fd82-40cb-b4f6-69f3dbb330fa tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154e4a8700>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:34.491594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-70e6f850-8145-4586-a068-6bdedbfc429b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.132203 Mar 30 07:15:34.492486 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 30 07:15:34.498714 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0eb4ee18-fd82-40cb-b4f6-69f3dbb330fa tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0a6e9ca7-a117-40b6-8f95-f77a508b7dfd" status: 200 len: 350 microversion: 2.1 time: 0.081267 Mar 30 07:15:34.499291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:15:34 2022] GET /compute/v2.1/os-volumes/0a6e9ca7-a117-40b6-8f95-f77a508b7dfd => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:15:34.505136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e92f8be4-6366-46ac-9d0c-e9ef88e27e77 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:34.509058 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e92f8be4-6366-46ac-9d0c-e9ef88e27e77 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:34.664896 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e92f8be4-6366-46ac-9d0c-e9ef88e27e77 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:34.699886 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e92f8be4-6366-46ac-9d0c-e9ef88e27e77 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1215 microversion: 2.1 time: 0.198975 Mar 30 07:15:34.703368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:34 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:35.735378 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f9d44af8-0578-4600-85da-b629357f06d5 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:35.736253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f9d44af8-0578-4600-85da-b629357f06d5 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:36.038177 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f9d44af8-0578-4600-85da-b629357f06d5 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:36.080243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f9d44af8-0578-4600-85da-b629357f06d5 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1215 microversion: 2.1 time: 0.352219 Mar 30 07:15:36.081855 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:35 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1215 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:37.099160 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-40df5227-7182-48f2-9277-4a74105172ae tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:37.100809 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-40df5227-7182-48f2-9277-4a74105172ae tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:37.113938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-40df5227-7182-48f2-9277-4a74105172ae tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:37.116397 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-40df5227-7182-48f2-9277-4a74105172ae tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:37.117245 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-40df5227-7182-48f2-9277-4a74105172ae tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:37.117698 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-40df5227-7182-48f2-9277-4a74105172ae tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:37.488561 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-40df5227-7182-48f2-9277-4a74105172ae tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:37.510172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-40df5227-7182-48f2-9277-4a74105172ae tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1219 microversion: 2.1 time: 0.414187 Mar 30 07:15:37.512915 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:37 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1219 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:38.253602 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d12a3578-2473-49db-9565-25c45a14d2a3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'create', calling method: .version_select at 0x7f154e421280>, body: {"keypair": {"name": "tempest-keypair-897316518"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:38.351985 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-d12a3578-2473-49db-9565-25c45a14d2a3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for project 8ee09b83520e4e8ba691a79d60604388. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:38.386081 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-d12a3578-2473-49db-9565-25c45a14d2a3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for user 93c4c81f994a48feb4d712c6b5120996 and project 8ee09b83520e4e8ba691a79d60604388. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:38.472682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-cd5e2b70-8a1c-41de-bdc8-96ec53ed3230 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154d2db4c0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:38.679654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-cd5e2b70-8a1c-41de-bdc8-96ec53ed3230 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/bfe64f7b-d0ca-46fa-bec9-ccfd77949fbe" status: 200 len: 351 microversion: 2.1 time: 0.213949 Mar 30 07:15:38.681216 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:15:38 2022] GET /compute/v2.1/os-volumes/bfe64f7b-d0ca-46fa-bec9-ccfd77949fbe => generated 351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:38.686005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f03d8f9a-08d1-46fc-88fe-54314d19c2db tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:38.686771 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f03d8f9a-08d1-46fc-88fe-54314d19c2db tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:38.712198 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f03d8f9a-08d1-46fc-88fe-54314d19c2db tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:38.714229 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f03d8f9a-08d1-46fc-88fe-54314d19c2db tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:38.722794 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f03d8f9a-08d1-46fc-88fe-54314d19c2db tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:38.724402 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f03d8f9a-08d1-46fc-88fe-54314d19c2db tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:39.044095 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-d12a3578-2473-49db-9565-25c45a14d2a3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for project 8ee09b83520e4e8ba691a79d60604388. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:39.056123 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-d12a3578-2473-49db-9565-25c45a14d2a3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for user 93c4c81f994a48feb4d712c6b5120996 and project 8ee09b83520e4e8ba691a79d60604388. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:39.114024 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d12a3578-2473-49db-9565-25c45a14d2a3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.367964 Mar 30 07:15:39.115457 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 4/8] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Mar 30 07:15:37 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1370 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 30 07:15:39.135405 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fbfbafcb-6d5c-471b-8911-0913743e2a26 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154e3c8040>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:39.400083 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fbfbafcb-6d5c-471b-8911-0913743e2a26 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.281864 Mar 30 07:15:39.401060 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Mar 30 07:15:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:39.419697 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-202c3986-d193-4548-8075-b6438c7615bb tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154e3c8e50>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:39.579786 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f03d8f9a-08d1-46fc-88fe-54314d19c2db tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:39.594197 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f03d8f9a-08d1-46fc-88fe-54314d19c2db tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1273 microversion: 2.1 time: 0.907416 Mar 30 07:15:39.603897 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:38 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1273 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:39.625801 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-202c3986-d193-4548-8075-b6438c7615bb tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.215637 Mar 30 07:15:39.626781 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Mar 30 07:15:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:39.641269 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-04da8c15-12ff-465f-a7ed-69cd55b17c4b tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154d27a550>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:39.814333 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-04da8c15-12ff-465f-a7ed-69cd55b17c4b tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.177763 Mar 30 07:15:39.814907 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Mar 30 07:15:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:39.826464 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-145de94f-1c4e-4ccb-837e-b36bf1fa2512 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154e3c8a60>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:40.006415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-145de94f-1c4e-4ccb-837e-b36bf1fa2512 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.184058 Mar 30 07:15:40.007470 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Mar 30 07:15:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:40.020807 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-787f0023-5830-4457-a767-465eccc424e3 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154d27a8b0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:40.225865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-787f0023-5830-4457-a767-465eccc424e3 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.208883 Mar 30 07:15:40.226926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Mar 30 07:15:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:40.240968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-78964b2b-45d8-49f5-b2cf-192fd9e6fc0f tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154e38eee0>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:40.469641 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-78964b2b-45d8-49f5-b2cf-192fd9e6fc0f tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.232286 Mar 30 07:15:40.470424 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Mar 30 07:15:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:40.482223 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e36386d9-8f67-4c64-b52e-ebc9d82db275 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154d27a430>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:40.607188 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-633ba06c-ecbc-4934-ab8a-e13fce140def tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:40.607882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-633ba06c-ecbc-4934-ab8a-e13fce140def tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:40.632184 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-633ba06c-ecbc-4934-ab8a-e13fce140def tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:40.632643 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-633ba06c-ecbc-4934-ab8a-e13fce140def tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:40.633530 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-633ba06c-ecbc-4934-ab8a-e13fce140def tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:40.633856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-633ba06c-ecbc-4934-ab8a-e13fce140def tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:40.878905 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e36386d9-8f67-4c64-b52e-ebc9d82db275 tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.401063 Mar 30 07:15:40.879864 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1187 bytes} [Wed Mar 30 07:15:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:40.893205 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-01595bb5-4fd8-421e-901d-7046d3a8e12f tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] Calling method '.version_select at 0x7f154d27ae50>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:41.136923 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-01595bb5-4fd8-421e-901d-7046d3a8e12f tempest-VolumesTestJSON-1811072872 tempest-VolumesTestJSON-1811072872-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.247406 Mar 30 07:15:41.137685 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 9/17] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Mar 30 07:15:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:15:41.243434 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-633ba06c-ecbc-4934-ab8a-e13fce140def tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:41.283934 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-633ba06c-ecbc-4934-ab8a-e13fce140def tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1273 microversion: 2.1 time: 0.667411 Mar 30 07:15:41.295023 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 9/18] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:40 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1273 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:42.302326 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b920ebd3-698f-4286-aa11-e960cb4553f9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:42.303045 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b920ebd3-698f-4286-aa11-e960cb4553f9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:42.313968 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b920ebd3-698f-4286-aa11-e960cb4553f9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:42.332382 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b920ebd3-698f-4286-aa11-e960cb4553f9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:42.333249 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b920ebd3-698f-4286-aa11-e960cb4553f9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:42.333693 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b920ebd3-698f-4286-aa11-e960cb4553f9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:42.611877 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-006dd8dc-30ab-464f-9ebe-1b9986abe568 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'create', calling method: .version_select at 0x7f154dafce50>, body: {"keypair": {"name": "tempest-keypair-1484575127"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:42.660978 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-006dd8dc-30ab-464f-9ebe-1b9986abe568 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for project cc9ab7163ff443ff849d017d40115708. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:42.668951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-006dd8dc-30ab-464f-9ebe-1b9986abe568 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for user 8dd9d32c47014294a367654b57c96f3f and project cc9ab7163ff443ff849d017d40115708. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:42.677769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b920ebd3-698f-4286-aa11-e960cb4553f9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:42.690315 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b920ebd3-698f-4286-aa11-e960cb4553f9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1273 microversion: 2.1 time: 0.391035 Mar 30 07:15:42.691563 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 10/19] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:42 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1273 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:43.645368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1356952699", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:43.770577 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] validate_networks() for [('b9678c55-7461-4938-ba80-6574cdde20b1', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:15:44.136654 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-006dd8dc-30ab-464f-9ebe-1b9986abe568 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for project cc9ab7163ff443ff849d017d40115708. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:44.147900 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-006dd8dc-30ab-464f-9ebe-1b9986abe568 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for user 8dd9d32c47014294a367654b57c96f3f and project cc9ab7163ff443ff849d017d40115708. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:44.183104 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-006dd8dc-30ab-464f-9ebe-1b9986abe568 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.865786 Mar 30 07:15:44.185904 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:15:42 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:15:44.198944 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2a7b6aea-820c-458c-8447-ff53838c4532 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:44.201355 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2a7b6aea-820c-458c-8447-ff53838c4532 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:44.241873 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2a7b6aea-820c-458c-8447-ff53838c4532 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:44.249410 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2a7b6aea-820c-458c-8447-ff53838c4532 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:44.250767 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2a7b6aea-820c-458c-8447-ff53838c4532 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:44.251411 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2a7b6aea-820c-458c-8447-ff53838c4532 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:44.976140 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:15:44.976618 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:15:44.976981 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:15:44.977389 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:15:44.977797 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:15:44.990752 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:44.993517 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:44.995252 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:45.001296 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:45.088487 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for project b5ef95aec46649a2b057416827ea46aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:45.112242 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for user bc84d32966d34ff29620cd40d3d9cc3a and project b5ef95aec46649a2b057416827ea46aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:45.155236 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:15:45.174088 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:15:45.308460 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4105902b-dc4b-41ec-b318-5beaf39bd720 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.830547 Mar 30 07:15:45.314816 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 11/21] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:15:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:15:45.320340 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5afdfaaa-7024-4c9b-939d-e60a0b2ea4b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:45.324556 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5afdfaaa-7024-4c9b-939d-e60a0b2ea4b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:45.372978 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2a7b6aea-820c-458c-8447-ff53838c4532 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:45.386028 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2a7b6aea-820c-458c-8447-ff53838c4532 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 1.198780 Mar 30 07:15:45.396226 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:44 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:45.597698 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5afdfaaa-7024-4c9b-939d-e60a0b2ea4b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:45.604942 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5afdfaaa-7024-4c9b-939d-e60a0b2ea4b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1222 microversion: 2.1 time: 0.288711 Mar 30 07:15:45.613669 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:45 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1222 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:45.916334 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-669345785", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:46.185807 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] validate_networks() for [('b9678c55-7461-4938-ba80-6574cdde20b1', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:15:46.404500 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bfa5cb81-0dae-48af-8856-899d69138f62 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:46.405129 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bfa5cb81-0dae-48af-8856-899d69138f62 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:46.412277 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bfa5cb81-0dae-48af-8856-899d69138f62 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:46.435098 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bfa5cb81-0dae-48af-8856-899d69138f62 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:46.435437 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bfa5cb81-0dae-48af-8856-899d69138f62 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:46.435912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bfa5cb81-0dae-48af-8856-899d69138f62 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:48.171695 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bfa5cb81-0dae-48af-8856-899d69138f62 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:48.181998 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bfa5cb81-0dae-48af-8856-899d69138f62 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 1.781683 Mar 30 07:15:48.195494 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:46 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:49.090364 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-548802814", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89db86be-e389-43ed-80e6-11e20145eaf2"}], "security_groups": [{"name": "tempest-securitygroup--1528818737"}], "key_name": "tempest-keypair-897316518", "user_data": "}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:49.571688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:15:49.572393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:15:49.573084 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:15:49.573620 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:15:49.574143 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:15:49.600715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:49.602047 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:49.607286 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:49.608947 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:49.702322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for project b5ef95aec46649a2b057416827ea46aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:49.715559 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for user bc84d32966d34ff29620cd40d3d9cc3a and project b5ef95aec46649a2b057416827ea46aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:49.722312 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] validate_networks() for [('89db86be-e389-43ed-80e6-11e20145eaf2', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:15:49.771757 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:15:49.778410 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:15:49.951898 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f29a4bc6-ba68-493d-94b6-e4e8cc3f2ce9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.043601 Mar 30 07:15:49.952768 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 12/25] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:15:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 4045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:15:49.958457 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3c444677-8c06-4992-a0ed-b2e6483b03a4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:49.959366 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3c444677-8c06-4992-a0ed-b2e6483b03a4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:49.974260 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3c444677-8c06-4992-a0ed-b2e6483b03a4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:49.975072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3c444677-8c06-4992-a0ed-b2e6483b03a4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:49.978968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3c444677-8c06-4992-a0ed-b2e6483b03a4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:49.979613 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3c444677-8c06-4992-a0ed-b2e6483b03a4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:51.532726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3c444677-8c06-4992-a0ed-b2e6483b03a4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:51.545989 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3c444677-8c06-4992-a0ed-b2e6483b03a4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 1.588710 Mar 30 07:15:51.554482 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:49 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:51.601224 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1edb844c-b962-42b8-b545-fc45d7e49868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:51.602215 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1edb844c-b962-42b8-b545-fc45d7e49868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:51.663474 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1edb844c-b962-42b8-b545-fc45d7e49868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:51.666736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1edb844c-b962-42b8-b545-fc45d7e49868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:51.670636 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1edb844c-b962-42b8-b545-fc45d7e49868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:51.671310 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1edb844c-b962-42b8-b545-fc45d7e49868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:53.212333 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1edb844c-b962-42b8-b545-fc45d7e49868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:53.222135 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1edb844c-b962-42b8-b545-fc45d7e49868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1273 microversion: 2.1 time: 1.663517 Mar 30 07:15:53.222941 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:51 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1273 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:53.846546 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-5c79e94e-2ac6-412a-9894-a3239212e819 req-d786b8b1-18da-449c-9577-0633520cb3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e395dc-f645-44ef-a69c-b609fcfb7c13", "tag": "83614a76-4b14-423b-938c-f966a668f09c"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:53.868185 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-5c79e94e-2ac6-412a-9894-a3239212e819 req-d786b8b1-18da-449c-9577-0633520cb3bd service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:53.869943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-5c79e94e-2ac6-412a-9894-a3239212e819 req-d786b8b1-18da-449c-9577-0633520cb3bd service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:53.940650 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-5c79e94e-2ac6-412a-9894-a3239212e819 req-d786b8b1-18da-449c-9577-0633520cb3bd service nova] Creating event network-changed:83614a76-4b14-423b-938c-f966a668f09c for instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 on hv-cinder-83577 Mar 30 07:15:53.942022 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-5c79e94e-2ac6-412a-9894-a3239212e819 req-d786b8b1-18da-449c-9577-0633520cb3bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117063) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 30 07:15:53.946686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fd92fa03-d50c-4ece-a088-30cec7ddab1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:53.947359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fd92fa03-d50c-4ece-a088-30cec7ddab1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:53.949269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fd92fa03-d50c-4ece-a088-30cec7ddab1c None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:53.951690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fd92fa03-d50c-4ece-a088-30cec7ddab1c None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:53.966738 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.compute.rpcapi [None req-fd92fa03-d50c-4ece-a088-30cec7ddab1c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 30 07:15:53.967921 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fd92fa03-d50c-4ece-a088-30cec7ddab1c None None] Releasing lock "compute-rpcapi-router" {{(pid=117063) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 30 07:15:54.022024 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fd92fa03-d50c-4ece-a088-30cec7ddab1c None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.796872 Mar 30 07:15:54.022837 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:54.053658 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-73f62b63-2414-4405-a825-24dd0ea771ec tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:54.055015 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-73f62b63-2414-4405-a825-24dd0ea771ec tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:54.080487 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-73f62b63-2414-4405-a825-24dd0ea771ec tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:54.081253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-73f62b63-2414-4405-a825-24dd0ea771ec tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:54.082225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-73f62b63-2414-4405-a825-24dd0ea771ec tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:54.085606 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-73f62b63-2414-4405-a825-24dd0ea771ec tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:54.777453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:15:54.777453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:15:54.777453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:15:54.777453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:15:54.777453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:15:54.793822 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:54.794370 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:54.796838 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:54.797303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:54.863555 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for project 8ee09b83520e4e8ba691a79d60604388. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:54.886178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for user 93c4c81f994a48feb4d712c6b5120996 and project 8ee09b83520e4e8ba691a79d60604388. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:54.918263 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:15:54.924898 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:15:55.034495 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4d9986ff-7c21-433f-9690-2d2a2e383445 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.948473 Mar 30 07:15:55.038697 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 14/29] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Mar 30 07:15:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 5953 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 30 07:15:55.051387 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-823c8ddb-e46d-4b42-95a0-7a99aa2c3b69 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:55.054433 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-823c8ddb-e46d-4b42-95a0-7a99aa2c3b69 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:55.100856 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-823c8ddb-e46d-4b42-95a0-7a99aa2c3b69 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:55.101321 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-823c8ddb-e46d-4b42-95a0-7a99aa2c3b69 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:55.102137 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-823c8ddb-e46d-4b42-95a0-7a99aa2c3b69 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:55.108964 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-823c8ddb-e46d-4b42-95a0-7a99aa2c3b69 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:55.195798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-73f62b63-2414-4405-a825-24dd0ea771ec tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:55.212313 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-73f62b63-2414-4405-a825-24dd0ea771ec tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 1.186970 Mar 30 07:15:55.213397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 16/30] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:54 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:55.218339 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f42387e4-0c5e-4d07-b389-57ce8c908f60 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:55.218951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f42387e4-0c5e-4d07-b389-57ce8c908f60 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:55.340946 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-823c8ddb-e46d-4b42-95a0-7a99aa2c3b69 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:55.349424 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-823c8ddb-e46d-4b42-95a0-7a99aa2c3b69 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1279 microversion: 2.1 time: 0.308056 Mar 30 07:15:55.362115 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 15/31] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:55 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1279 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:55.474620 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f42387e4-0c5e-4d07-b389-57ce8c908f60 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:55.486553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f42387e4-0c5e-4d07-b389-57ce8c908f60 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:55.491353 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f42387e4-0c5e-4d07-b389-57ce8c908f60 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:55.493012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f42387e4-0c5e-4d07-b389-57ce8c908f60 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1280 microversion: 2.20 time: 0.278955 Mar 30 07:15:55.493891 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 17/32] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:15:55 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1280 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:15:55.770444 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-235e47db-0565-4c97-ae15-a60c41ca21fb tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Action: 'create', calling method: .version_select at 0x7f154f178c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-17664626", "metadata": {"Type": "work"}}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:55.772338 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-235e47db-0565-4c97-ae15-a60c41ca21fb tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:15:55.773300 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-235e47db-0565-4c97-ae15-a60c41ca21fb tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.409958 Mar 30 07:15:55.775309 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 16/33] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Mar 30 07:15:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 412 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:15:55.783924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0b4080f1-1406-437f-9175-c96ba12a53f5 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Action: 'create', calling method: .version_select at 0x7f154da27040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1033420756", "metadata": {"Type": "work"}}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:55.785811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0b4080f1-1406-437f-9175-c96ba12a53f5 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:15:55.786818 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0b4080f1-1406-437f-9175-c96ba12a53f5 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006916 Mar 30 07:15:55.787906 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 18/34] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Mar 30 07:15:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:15:55.798454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-053fd7f7-4443-4c66-8995-ff76ef7ce751 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Action: 'create', calling method: .version_select at 0x7f154d282670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1044594892", "metadata": {"Type": "work"}}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:55.800081 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-053fd7f7-4443-4c66-8995-ff76ef7ce751 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:15:55.800887 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-053fd7f7-4443-4c66-8995-ff76ef7ce751 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006428 Mar 30 07:15:55.807250 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 17/35] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Mar 30 07:15:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:15:55.813943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3eef9fa1-da5f-43a3-b8e6-d611263eab3f tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Calling method '.version_select at 0x7f1554298ee0>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:55.868615 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-3eef9fa1-da5f-43a3-b8e6-d611263eab3f tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] HTTP exception thrown: Volume tempest-invalid-222676623 could not be found. Mar 30 07:15:55.869781 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3eef9fa1-da5f-43a3-b8e6-d611263eab3f tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Returning 404 to user: Volume tempest-invalid-222676623 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:15:55.870871 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3eef9fa1-da5f-43a3-b8e6-d611263eab3f tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-222676623" status: 404 len: 98 microversion: 2.1 time: 0.062678 Mar 30 07:15:55.871844 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1214 bytes} [Wed Mar 30 07:15:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-222676623 => generated 98 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 30 07:15:55.883564 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-270c2247-9eb8-4cfd-a3e2-fc8146fdb3f4 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004232 Mar 30 07:15:55.884203 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 18/37] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Mar 30 07:15:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 30 07:15:55.896631 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c44d2b6b-87b7-46e0-8f29-c3020e4acabf tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006112 Mar 30 07:15:55.897275 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Mar 30 07:15:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 30 07:15:55.909382 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f8a66be1-f146-480c-b928-9a184348dc94 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Calling method '.version_select at 0x7f154d282ee0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:55.995014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-f8a66be1-f146-480c-b928-9a184348dc94 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] HTTP exception thrown: Volume ec617622-5da6-48c3-8a9e-d836a7689349 could not be found. Mar 30 07:15:55.995885 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f8a66be1-f146-480c-b928-9a184348dc94 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Returning 404 to user: Volume ec617622-5da6-48c3-8a9e-d836a7689349 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:15:55.997170 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f8a66be1-f146-480c-b928-9a184348dc94 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/ec617622-5da6-48c3-8a9e-d836a7689349" status: 404 len: 109 microversion: 2.1 time: 0.091699 Mar 30 07:15:55.997744 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 19/39] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:15:55 2022] DELETE /compute/v2.1/os-volumes/ec617622-5da6-48c3-8a9e-d836a7689349 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:15:56.015732 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c700ae41-53af-4558-ab9b-7ad21c664de3 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Calling method '.version_select at 0x7f154da209d0>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:56.075103 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-c700ae41-53af-4558-ab9b-7ad21c664de3 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] HTTP exception thrown: Volume 5651a5c2-b523-4da0-82f4-debfb562c09d could not be found. Mar 30 07:15:56.076409 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c700ae41-53af-4558-ab9b-7ad21c664de3 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] Returning 404 to user: Volume 5651a5c2-b523-4da0-82f4-debfb562c09d could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:15:56.077444 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c700ae41-53af-4558-ab9b-7ad21c664de3 tempest-VolumesNegativeTest-1573350896 tempest-VolumesNegativeTest-1573350896-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5651a5c2-b523-4da0-82f4-debfb562c09d" status: 404 len: 109 microversion: 2.1 time: 0.072267 Mar 30 07:15:56.078656 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:15:56 2022] GET /compute/v2.1/os-volumes/5651a5c2-b523-4da0-82f4-debfb562c09d => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 30 07:15:56.241848 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a6d74b02-5a70-4267-9156-1b6a82c02627 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:56.242818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a6d74b02-5a70-4267-9156-1b6a82c02627 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:56.265763 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a6d74b02-5a70-4267-9156-1b6a82c02627 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:56.266619 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a6d74b02-5a70-4267-9156-1b6a82c02627 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:56.270386 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a6d74b02-5a70-4267-9156-1b6a82c02627 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:56.271206 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a6d74b02-5a70-4267-9156-1b6a82c02627 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:56.366563 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-06486292-c2f6-43d3-9f22-6cc559e6a86c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:56.367982 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-06486292-c2f6-43d3-9f22-6cc559e6a86c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:56.375261 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-06486292-c2f6-43d3-9f22-6cc559e6a86c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:56.379257 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-06486292-c2f6-43d3-9f22-6cc559e6a86c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:56.380385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-06486292-c2f6-43d3-9f22-6cc559e6a86c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:56.381007 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-06486292-c2f6-43d3-9f22-6cc559e6a86c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:56.497848 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-06486292-c2f6-43d3-9f22-6cc559e6a86c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:56.508619 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-06486292-c2f6-43d3-9f22-6cc559e6a86c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1279 microversion: 2.1 time: 0.143522 Mar 30 07:15:56.510425 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:56 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:15:56.517350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:56.518096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:56.524775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:56.525516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:56.526497 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:56.527113 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:56.800335 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:56.808905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:56.810396 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:56.811665 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ccd99e66-1f4f-4409-8db0-1b98dfe940ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1332 microversion: 2.20 time: 0.299521 Mar 30 07:15:56.828569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 23/42] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:15:56 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1332 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:15:57.200785 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a6d74b02-5a70-4267-9156-1b6a82c02627 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:57.224681 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a6d74b02-5a70-4267-9156-1b6a82c02627 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.988533 Mar 30 07:15:57.228528 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 20/43] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:56 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:57.393272 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1190126763", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdc48dd9-ac72-4ec1-96d3-56de9895320a"}], "security_groups": [{"name": "tempest-securitygroup--737760964"}], "key_name": "tempest-keypair-1484575127", "user_data": "}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:57.526756 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6fb7069f-3b53-42b3-8cb7-c2e6ed687505 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:57.527569 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6fb7069f-3b53-42b3-8cb7-c2e6ed687505 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:57.534442 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6fb7069f-3b53-42b3-8cb7-c2e6ed687505 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:57.539082 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6fb7069f-3b53-42b3-8cb7-c2e6ed687505 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:57.541842 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6fb7069f-3b53-42b3-8cb7-c2e6ed687505 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:57.543048 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6fb7069f-3b53-42b3-8cb7-c2e6ed687505 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:57.712739 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] validate_networks() for [('fdc48dd9-ac72-4ec1-96d3-56de9895320a', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:15:58.085704 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6fb7069f-3b53-42b3-8cb7-c2e6ed687505 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:58.103616 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6fb7069f-3b53-42b3-8cb7-c2e6ed687505 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.571803 Mar 30 07:15:58.104297 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 21/44] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:57 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:58.111478 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:58.112044 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:58.120046 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.120794 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.121922 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.122506 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.210007 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:58.226478 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:58.228115 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:58.230227 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-745ea341-9eea-4eb6-bfb8-25c3cfce9a00 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1338 microversion: 2.20 time: 0.124177 Mar 30 07:15:58.231765 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:15:58 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1338 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:15:58.426742 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-03d312c2-2f47-45a0-8207-d639cd1933fd req-f1a6e30b-f3d7-4676-8b0d-79f50ab82d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fedaffa-1632-4376-a01c-64b81265770e", "tag": "8b69b063-2bbd-4852-b768-a54773d55703"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:58.452690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-03d312c2-2f47-45a0-8207-d639cd1933fd req-f1a6e30b-f3d7-4676-8b0d-79f50ab82d10 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.453530 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-03d312c2-2f47-45a0-8207-d639cd1933fd req-f1a6e30b-f3d7-4676-8b0d-79f50ab82d10 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.488013 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-03d312c2-2f47-45a0-8207-d639cd1933fd req-f1a6e30b-f3d7-4676-8b0d-79f50ab82d10 service nova] Creating event network-changed:8b69b063-2bbd-4852-b768-a54773d55703 for instance 7fedaffa-1632-4376-a01c-64b81265770e on hv-cinder-83577 Mar 30 07:15:58.488991 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-03d312c2-2f47-45a0-8207-d639cd1933fd req-f1a6e30b-f3d7-4676-8b0d-79f50ab82d10 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 30 07:15:58.490324 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6244f431-cf44-47f4-84a6-899e4071e8ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.490974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6244f431-cf44-47f4-84a6-899e4071e8ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.491989 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6244f431-cf44-47f4-84a6-899e4071e8ab None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.492761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6244f431-cf44-47f4-84a6-899e4071e8ab None None] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.504976 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.compute.rpcapi [None req-6244f431-cf44-47f4-84a6-899e4071e8ab None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 30 07:15:58.506378 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6244f431-cf44-47f4-84a6-899e4071e8ab None None] Releasing lock "compute-rpcapi-router" {{(pid=117062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 30 07:15:58.540709 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6244f431-cf44-47f4-84a6-899e4071e8ab None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.307499 Mar 30 07:15:58.542498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 23/46] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:58.548748 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bc0aa4b7-5515-492b-b2dc-daccfe4dd993 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:58.549559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bc0aa4b7-5515-492b-b2dc-daccfe4dd993 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:58.556222 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bc0aa4b7-5515-492b-b2dc-daccfe4dd993 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.557094 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bc0aa4b7-5515-492b-b2dc-daccfe4dd993 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.558179 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bc0aa4b7-5515-492b-b2dc-daccfe4dd993 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.558826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bc0aa4b7-5515-492b-b2dc-daccfe4dd993 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.846029 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:15:58.846536 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:15:58.847300 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:15:58.847892 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:15:58.848378 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:15:58.861589 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.862540 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.864148 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.874841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.898740 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for project cc9ab7163ff443ff849d017d40115708. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:15:58.903900 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for user 8dd9d32c47014294a367654b57c96f3f and project cc9ab7163ff443ff849d017d40115708. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:15:58.919409 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:15:58.922674 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:15:58.926226 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bc0aa4b7-5515-492b-b2dc-daccfe4dd993 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:58.950430 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bc0aa4b7-5515-492b-b2dc-daccfe4dd993 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.406113 Mar 30 07:15:58.951059 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 24/47] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:58 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:58.958895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-b9971c6c-60b3-4f46-9343-4face44a6a42 req-8c5a1e84-0bec-480f-9290-d9d315fa133c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d831174-317c-4c6d-b5b7-e01974621585", "tag": "2143af28-585c-4f87-adef-e00385fa7b91"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:15:58.972411 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-b9971c6c-60b3-4f46-9343-4face44a6a42 req-8c5a1e84-0bec-480f-9290-d9d315fa133c service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:58.972855 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-b9971c6c-60b3-4f46-9343-4face44a6a42 req-8c5a1e84-0bec-480f-9290-d9d315fa133c service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:58.988133 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-b9971c6c-60b3-4f46-9343-4face44a6a42 req-8c5a1e84-0bec-480f-9290-d9d315fa133c service nova] Creating event network-changed:2143af28-585c-4f87-adef-e00385fa7b91 for instance 1d831174-317c-4c6d-b5b7-e01974621585 on hv-cinder-83577 Mar 30 07:15:58.991970 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b402953e-b630-4fbc-8cba-a90c8f64ae65 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.602681 Mar 30 07:15:58.993602 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 24/48] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:15:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:15:58.996672 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-b9971c6c-60b3-4f46-9343-4face44a6a42 req-8c5a1e84-0bec-480f-9290-d9d315fa133c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040878 Mar 30 07:15:58.997432 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 25/49] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:15:59.010427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5f89329a-e0f2-4fb3-a983-c5bde7195780 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:59.011925 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5f89329a-e0f2-4fb3-a983-c5bde7195780 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:59.073211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5f89329a-e0f2-4fb3-a983-c5bde7195780 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:59.086225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5f89329a-e0f2-4fb3-a983-c5bde7195780 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1238 microversion: 2.1 time: 0.081092 Mar 30 07:15:59.087557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 25/50] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:59 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:59.122156 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5063adb2-fa53-4b68-ba1d-c29b9bbbb132 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:59.123092 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5063adb2-fa53-4b68-ba1d-c29b9bbbb132 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:59.145040 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5063adb2-fa53-4b68-ba1d-c29b9bbbb132 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:59.150666 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5063adb2-fa53-4b68-ba1d-c29b9bbbb132 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:59.151556 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5063adb2-fa53-4b68-ba1d-c29b9bbbb132 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:59.152117 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5063adb2-fa53-4b68-ba1d-c29b9bbbb132 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:59.252092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:59.253039 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:59.261154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:59.261968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:59.263438 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:59.264334 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:59.375117 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5063adb2-fa53-4b68-ba1d-c29b9bbbb132 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:59.376553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:59.388176 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:59.388540 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5063adb2-fa53-4b68-ba1d-c29b9bbbb132 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.271407 Mar 30 07:15:59.389146 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 26/51] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:59 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:15:59.392484 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:15:59.395325 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7ff670c3-e07b-4430-a59c-e4af5a3d564b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1338 microversion: 2.20 time: 0.148066 Mar 30 07:15:59.397323 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:15:59 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1338 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:15:59.968565 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0f9c67b0-f3b6-4101-ba04-f065245b8557 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:15:59.969185 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0f9c67b0-f3b6-4101-ba04-f065245b8557 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:15:59.975344 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0f9c67b0-f3b6-4101-ba04-f065245b8557 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:59.975726 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0f9c67b0-f3b6-4101-ba04-f065245b8557 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:15:59.976672 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0f9c67b0-f3b6-4101-ba04-f065245b8557 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:15:59.976975 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0f9c67b0-f3b6-4101-ba04-f065245b8557 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:00.104924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-93d3731c-680e-4e04-a719-57a3f08a4448 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:00.106187 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-93d3731c-680e-4e04-a719-57a3f08a4448 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:00.117545 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93d3731c-680e-4e04-a719-57a3f08a4448 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:00.117545 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93d3731c-680e-4e04-a719-57a3f08a4448 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:00.117545 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93d3731c-680e-4e04-a719-57a3f08a4448 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:00.117545 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93d3731c-680e-4e04-a719-57a3f08a4448 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:00.128214 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0f9c67b0-f3b6-4101-ba04-f065245b8557 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:00.135992 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0f9c67b0-f3b6-4101-ba04-f065245b8557 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.171230 Mar 30 07:16:00.136910 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 27/53] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:15:59 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:00.180112 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-93d3731c-680e-4e04-a719-57a3f08a4448 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:00.187359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-93d3731c-680e-4e04-a719-57a3f08a4448 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1242 microversion: 2.1 time: 0.087112 Mar 30 07:16:00.187955 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 27/54] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:00 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:00.408051 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fe023b5b-e68f-403d-9575-4d0372f3f62e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:00.408866 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fe023b5b-e68f-403d-9575-4d0372f3f62e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:00.414408 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:00.415332 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:00.438001 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:00.438914 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:00.442553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:00.442827 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fe023b5b-e68f-403d-9575-4d0372f3f62e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:00.445811 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fe023b5b-e68f-403d-9575-4d0372f3f62e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:00.446497 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:00.447441 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fe023b5b-e68f-403d-9575-4d0372f3f62e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:00.452264 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fe023b5b-e68f-403d-9575-4d0372f3f62e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:00.576323 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:00.592449 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:00.594827 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:00.596385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4ebe2407-5e72-469d-88ff-4073999e2f86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1338 microversion: 2.20 time: 0.185777 Mar 30 07:16:00.597110 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 28/55] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:00 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:00.936862 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fe023b5b-e68f-403d-9575-4d0372f3f62e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:00.947652 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fe023b5b-e68f-403d-9575-4d0372f3f62e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.543915 Mar 30 07:16:00.948243 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 28/56] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:00 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:01.155019 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3ee8d3c5-53d9-4058-a8c3-188ab49b11d9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:01.156325 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3ee8d3c5-53d9-4058-a8c3-188ab49b11d9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:01.163240 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3ee8d3c5-53d9-4058-a8c3-188ab49b11d9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:01.166492 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3ee8d3c5-53d9-4058-a8c3-188ab49b11d9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:01.167998 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3ee8d3c5-53d9-4058-a8c3-188ab49b11d9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:01.168602 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3ee8d3c5-53d9-4058-a8c3-188ab49b11d9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:01.207275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6c596e4f-a8bf-4f03-9420-a488c624d862 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:01.207275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6c596e4f-a8bf-4f03-9420-a488c624d862 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:01.218723 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6c596e4f-a8bf-4f03-9420-a488c624d862 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:01.219178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6c596e4f-a8bf-4f03-9420-a488c624d862 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:01.219977 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6c596e4f-a8bf-4f03-9420-a488c624d862 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:01.230649 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6c596e4f-a8bf-4f03-9420-a488c624d862 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:01.391284 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6c596e4f-a8bf-4f03-9420-a488c624d862 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:01.406408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6c596e4f-a8bf-4f03-9420-a488c624d862 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1290 microversion: 2.1 time: 0.203954 Mar 30 07:16:01.407544 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 29/57] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:01 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1290 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:01.562154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3ee8d3c5-53d9-4058-a8c3-188ab49b11d9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:01.571959 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3ee8d3c5-53d9-4058-a8c3-188ab49b11d9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.422992 Mar 30 07:16:01.572733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 29/58] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:01 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:01.615476 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:01.616155 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:01.623327 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:01.623971 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:01.624744 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:01.625172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:01.772559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:01.780837 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:01.782338 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:01.783442 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7dc75637-954a-4476-96c3-67dbdf512397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.172187 Mar 30 07:16:01.784033 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 30/59] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:01 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:01.966213 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bca1bdc1-d36c-4911-8c81-44ca51bcb003 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:01.966847 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-bca1bdc1-d36c-4911-8c81-44ca51bcb003 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:01.973764 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bca1bdc1-d36c-4911-8c81-44ca51bcb003 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:01.974218 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bca1bdc1-d36c-4911-8c81-44ca51bcb003 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:01.974985 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bca1bdc1-d36c-4911-8c81-44ca51bcb003 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:01.975413 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bca1bdc1-d36c-4911-8c81-44ca51bcb003 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:02.114668 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-bca1bdc1-d36c-4911-8c81-44ca51bcb003 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:02.122555 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-bca1bdc1-d36c-4911-8c81-44ca51bcb003 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.161163 Mar 30 07:16:02.123157 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 30/60] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:01 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:02.426605 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-cb9cd93e-e998-47ea-82d4-753d7c72fa98 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:02.427218 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-cb9cd93e-e998-47ea-82d4-753d7c72fa98 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:02.433406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb9cd93e-e998-47ea-82d4-753d7c72fa98 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:02.433895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb9cd93e-e998-47ea-82d4-753d7c72fa98 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:02.434742 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb9cd93e-e998-47ea-82d4-753d7c72fa98 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:02.435174 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb9cd93e-e998-47ea-82d4-753d7c72fa98 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:02.496861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-cb9cd93e-e998-47ea-82d4-753d7c72fa98 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:02.505130 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-cb9cd93e-e998-47ea-82d4-753d7c72fa98 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1290 microversion: 2.1 time: 0.082414 Mar 30 07:16:02.505719 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 31/61] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:02 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:02.589505 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-070d10f3-1d04-43be-8ed0-a228807a676b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:02.591233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-070d10f3-1d04-43be-8ed0-a228807a676b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:02.597432 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-070d10f3-1d04-43be-8ed0-a228807a676b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:02.598214 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-070d10f3-1d04-43be-8ed0-a228807a676b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:02.599510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-070d10f3-1d04-43be-8ed0-a228807a676b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:02.600035 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-070d10f3-1d04-43be-8ed0-a228807a676b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:02.778693 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-070d10f3-1d04-43be-8ed0-a228807a676b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:02.786266 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-070d10f3-1d04-43be-8ed0-a228807a676b tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.200535 Mar 30 07:16:02.787166 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 31/62] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:02 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:02.801622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:02.802326 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:02.808640 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:02.809116 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:02.810072 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:02.810587 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:02.950473 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:02.959557 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:02.961110 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:02.965873 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7c64b686-f4fd-409b-a3e9-761b1732baaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.165182 Mar 30 07:16:02.966464 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 32/63] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:02 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:03.138983 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-64766c1f-cb8c-435e-9971-97aba844f6e1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:03.139832 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-64766c1f-cb8c-435e-9971-97aba844f6e1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:03.146158 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-64766c1f-cb8c-435e-9971-97aba844f6e1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:03.146609 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-64766c1f-cb8c-435e-9971-97aba844f6e1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:03.147390 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-64766c1f-cb8c-435e-9971-97aba844f6e1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:03.147833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-64766c1f-cb8c-435e-9971-97aba844f6e1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:03.297443 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-64766c1f-cb8c-435e-9971-97aba844f6e1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:03.304791 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-64766c1f-cb8c-435e-9971-97aba844f6e1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.169828 Mar 30 07:16:03.305369 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:03 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:03.525692 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-454a4cc8-a883-482f-88ab-954a62f24052 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:03.527377 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-454a4cc8-a883-482f-88ab-954a62f24052 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:03.537930 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-454a4cc8-a883-482f-88ab-954a62f24052 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:03.538949 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-454a4cc8-a883-482f-88ab-954a62f24052 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:03.539950 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-454a4cc8-a883-482f-88ab-954a62f24052 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:03.540561 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-454a4cc8-a883-482f-88ab-954a62f24052 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:03.635745 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-454a4cc8-a883-482f-88ab-954a62f24052 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:03.649751 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-454a4cc8-a883-482f-88ab-954a62f24052 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1290 microversion: 2.1 time: 0.130970 Mar 30 07:16:03.650856 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 33/65] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:03 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1290 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:03.808766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ca61053a-cae0-44ed-b2b1-c70870ac9c6d tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:03.809917 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ca61053a-cae0-44ed-b2b1-c70870ac9c6d tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:03.820582 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ca61053a-cae0-44ed-b2b1-c70870ac9c6d tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:03.820979 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ca61053a-cae0-44ed-b2b1-c70870ac9c6d tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:03.824487 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ca61053a-cae0-44ed-b2b1-c70870ac9c6d tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:03.826243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ca61053a-cae0-44ed-b2b1-c70870ac9c6d tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:03.984895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:03.986169 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:03.994878 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:03.997941 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:04.001088 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:04.002230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:04.564541 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ca61053a-cae0-44ed-b2b1-c70870ac9c6d tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:04.577304 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ca61053a-cae0-44ed-b2b1-c70870ac9c6d tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.774663 Mar 30 07:16:04.578753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:03 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:04.605906 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9e96f643-29cf-4864-9186-c798e23a5d6c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:04.607355 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9e96f643-29cf-4864-9186-c798e23a5d6c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:04.618245 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e96f643-29cf-4864-9186-c798e23a5d6c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:04.619138 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e96f643-29cf-4864-9186-c798e23a5d6c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:04.620469 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e96f643-29cf-4864-9186-c798e23a5d6c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:04.622967 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e96f643-29cf-4864-9186-c798e23a5d6c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:04.798577 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:04.807528 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:04.814407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:04.817470 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bd5e9fb7-8822-4f94-8057-f383e69a6448 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.837444 Mar 30 07:16:04.830715 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:03 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:16:04.836519 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f085f23e-fd6a-4124-8af9-f98526ccebdb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:04.838098 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f085f23e-fd6a-4124-8af9-f98526ccebdb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:04.851442 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f085f23e-fd6a-4124-8af9-f98526ccebdb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:04.851946 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f085f23e-fd6a-4124-8af9-f98526ccebdb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:04.852957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f085f23e-fd6a-4124-8af9-f98526ccebdb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:04.853562 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f085f23e-fd6a-4124-8af9-f98526ccebdb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:05.117711 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f085f23e-fd6a-4124-8af9-f98526ccebdb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:05.126037 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f085f23e-fd6a-4124-8af9-f98526ccebdb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1296 microversion: 2.1 time: 0.293768 Mar 30 07:16:05.126867 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:04 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1296 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:05.254926 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9e96f643-29cf-4864-9186-c798e23a5d6c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:05.270862 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9e96f643-29cf-4864-9186-c798e23a5d6c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.690360 Mar 30 07:16:05.273069 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:04 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:05.512517 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-d79220e1-df4a-4eb1-8535-05a40948f906 req-fdd8a9cd-eea1-4553-a147-26231181a147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d977a73f-876d-4d10-adf8-326ed77fc467", "tag": "46952506-ed7a-47ba-a4d4-3306605e4824"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:05.531802 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-d79220e1-df4a-4eb1-8535-05a40948f906 req-fdd8a9cd-eea1-4553-a147-26231181a147 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:05.532568 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-d79220e1-df4a-4eb1-8535-05a40948f906 req-fdd8a9cd-eea1-4553-a147-26231181a147 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:05.580741 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-d79220e1-df4a-4eb1-8535-05a40948f906 req-fdd8a9cd-eea1-4553-a147-26231181a147 service nova] Creating event network-changed:46952506-ed7a-47ba-a4d4-3306605e4824 for instance d977a73f-876d-4d10-adf8-326ed77fc467 on hv-cinder-83577 Mar 30 07:16:05.596293 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c94d48c7-437e-4c05-a706-960d67dd97fb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:05.596919 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c94d48c7-437e-4c05-a706-960d67dd97fb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:05.601420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-d79220e1-df4a-4eb1-8535-05a40948f906 req-fdd8a9cd-eea1-4553-a147-26231181a147 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093148 Mar 30 07:16:05.607109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c94d48c7-437e-4c05-a706-960d67dd97fb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:05.607743 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 36/70] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:16:05.611477 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c94d48c7-437e-4c05-a706-960d67dd97fb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:05.612726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c94d48c7-437e-4c05-a706-960d67dd97fb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:05.614407 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c94d48c7-437e-4c05-a706-960d67dd97fb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:05.839631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:05.840817 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:05.853156 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:05.854784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:05.857669 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:05.859588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:06.523204 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c94d48c7-437e-4c05-a706-960d67dd97fb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:06.534957 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c94d48c7-437e-4c05-a706-960d67dd97fb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.942533 Mar 30 07:16:06.536809 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 35/71] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:05 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:06.569166 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:06.581963 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:06.585692 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:06.588941 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-af1a4ab1-9123-4034-984a-770236b824c0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.755192 Mar 30 07:16:06.590716 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:05 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:16:06.599314 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-46c61e38-f6f7-49ee-afe0-a74a70eef348 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:06.604213 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-46c61e38-f6f7-49ee-afe0-a74a70eef348 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:06.620980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-46c61e38-f6f7-49ee-afe0-a74a70eef348 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:06.621643 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-46c61e38-f6f7-49ee-afe0-a74a70eef348 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:06.625350 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-46c61e38-f6f7-49ee-afe0-a74a70eef348 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:06.625926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-46c61e38-f6f7-49ee-afe0-a74a70eef348 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:06.834831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-b4945dae-7473-4349-979f-c9d173c5149d req-df9fbea9-f28a-427b-8235-12b155be48cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e395dc-f645-44ef-a69c-b609fcfb7c13", "name": "network-vif-plugged", "status": "completed", "tag": "83614a76-4b14-423b-938c-f966a668f09c"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:06.846823 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-b4945dae-7473-4349-979f-c9d173c5149d req-df9fbea9-f28a-427b-8235-12b155be48cd service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:06.847263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-b4945dae-7473-4349-979f-c9d173c5149d req-df9fbea9-f28a-427b-8235-12b155be48cd service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:06.860152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-b4945dae-7473-4349-979f-c9d173c5149d req-df9fbea9-f28a-427b-8235-12b155be48cd service nova] Creating event network-vif-plugged:83614a76-4b14-423b-938c-f966a668f09c for instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 on hv-cinder-83577 Mar 30 07:16:06.866347 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-b4945dae-7473-4349-979f-c9d173c5149d req-df9fbea9-f28a-427b-8235-12b155be48cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.327643 Mar 30 07:16:06.868547 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 36/73] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:16:06.880202 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-12cb7e27-be2c-43b7-8d66-3e690b75cdd3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:06.880901 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-12cb7e27-be2c-43b7-8d66-3e690b75cdd3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:06.891102 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-12cb7e27-be2c-43b7-8d66-3e690b75cdd3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:06.891553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-12cb7e27-be2c-43b7-8d66-3e690b75cdd3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:06.892363 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-12cb7e27-be2c-43b7-8d66-3e690b75cdd3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:06.892796 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-12cb7e27-be2c-43b7-8d66-3e690b75cdd3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:06.951895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-46c61e38-f6f7-49ee-afe0-a74a70eef348 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:06.959354 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-46c61e38-f6f7-49ee-afe0-a74a70eef348 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.367164 Mar 30 07:16:06.964042 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 38/74] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:06 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:07.125269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-12cb7e27-be2c-43b7-8d66-3e690b75cdd3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:07.134814 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-12cb7e27-be2c-43b7-8d66-3e690b75cdd3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.263827 Mar 30 07:16:07.137090 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 37/75] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:06 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:07.556718 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-01ac6777-92f8-410c-8465-2c2697eca3c4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:07.558182 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-01ac6777-92f8-410c-8465-2c2697eca3c4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:07.567784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-01ac6777-92f8-410c-8465-2c2697eca3c4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:07.568378 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-01ac6777-92f8-410c-8465-2c2697eca3c4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:07.569740 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-01ac6777-92f8-410c-8465-2c2697eca3c4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:07.570282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-01ac6777-92f8-410c-8465-2c2697eca3c4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:07.609254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:07.609987 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:07.625850 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:07.626565 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:07.633249 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:07.634484 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:07.928287 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:07.938803 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:07.941043 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:07.942924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-aed5cd0b-f77c-4a16-adfb-7e9b6027025b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.339873 Mar 30 07:16:07.952512 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-01ac6777-92f8-410c-8465-2c2697eca3c4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:07.954190 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:07 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:07.957415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-01ac6777-92f8-410c-8465-2c2697eca3c4 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.407300 Mar 30 07:16:07.968899 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 39/77] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:07 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:07.980598 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-973712e5-6c5f-4cb0-a37f-86b4c5df6a10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:07.982379 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-973712e5-6c5f-4cb0-a37f-86b4c5df6a10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:07.988792 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-973712e5-6c5f-4cb0-a37f-86b4c5df6a10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:07.989460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-973712e5-6c5f-4cb0-a37f-86b4c5df6a10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:07.990486 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-973712e5-6c5f-4cb0-a37f-86b4c5df6a10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:07.991003 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-973712e5-6c5f-4cb0-a37f-86b4c5df6a10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:08.121679 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-6e205146-102c-40a1-bfd9-cdcb898639fb req-ccfa2284-f4ae-4e90-a763-37f85771a84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea531783-864c-44f2-9311-d1939a112f2b", "tag": "cc0a9d6a-7177-46dd-b56e-afefa52539b0"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:08.134953 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-6e205146-102c-40a1-bfd9-cdcb898639fb req-ccfa2284-f4ae-4e90-a763-37f85771a84e service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:08.135756 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-6e205146-102c-40a1-bfd9-cdcb898639fb req-ccfa2284-f4ae-4e90-a763-37f85771a84e service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:08.178054 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-6e205146-102c-40a1-bfd9-cdcb898639fb req-ccfa2284-f4ae-4e90-a763-37f85771a84e service nova] Creating event network-changed:cc0a9d6a-7177-46dd-b56e-afefa52539b0 for instance ea531783-864c-44f2-9311-d1939a112f2b on hv-cinder-83577 Mar 30 07:16:08.185096 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-6e205146-102c-40a1-bfd9-cdcb898639fb req-ccfa2284-f4ae-4e90-a763-37f85771a84e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069292 Mar 30 07:16:08.187304 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 40/78] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:16:08.214576 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b3987f3d-47fd-4f85-a81d-b7c7415a5f41 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:08.218194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b3987f3d-47fd-4f85-a81d-b7c7415a5f41 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:08.233063 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3987f3d-47fd-4f85-a81d-b7c7415a5f41 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:08.233924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3987f3d-47fd-4f85-a81d-b7c7415a5f41 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:08.236117 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3987f3d-47fd-4f85-a81d-b7c7415a5f41 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:08.240746 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3987f3d-47fd-4f85-a81d-b7c7415a5f41 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:08.297498 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-973712e5-6c5f-4cb0-a37f-86b4c5df6a10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:08.307370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-973712e5-6c5f-4cb0-a37f-86b4c5df6a10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.330501 Mar 30 07:16:08.319800 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 39/79] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:07 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:08.590393 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b3987f3d-47fd-4f85-a81d-b7c7415a5f41 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:08.601624 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b3987f3d-47fd-4f85-a81d-b7c7415a5f41 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.412784 Mar 30 07:16:08.602613 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 41/80] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:08 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:08.963743 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:08.965077 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:08.976195 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-185dd97c-2577-4607-90e6-4f087734cd9e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:08.976454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-185dd97c-2577-4607-90e6-4f087734cd9e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:08.989926 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:08.990443 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:08.990870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-185dd97c-2577-4607-90e6-4f087734cd9e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:08.991653 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-185dd97c-2577-4607-90e6-4f087734cd9e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:08.993080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:08.993508 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-185dd97c-2577-4607-90e6-4f087734cd9e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:08.994576 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:08.995230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-185dd97c-2577-4607-90e6-4f087734cd9e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:09.757302 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:09.766158 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:09.771144 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:09.780898 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-185dd97c-2577-4607-90e6-4f087734cd9e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:09.789005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-185dd97c-2577-4607-90e6-4f087734cd9e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1315 microversion: 2.1 time: 0.818251 Mar 30 07:16:09.795627 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7c987450-b8b6-47e3-9174-245eab586aca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.831146 Mar 30 07:16:09.795713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 42/81] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:08 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:09.816344 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 40/82] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:08 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:09.821425 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d3e77ead-1f57-4e46-879e-6e6d89e59838 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:09.833128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-edaa48c8-ca4f-4496-88e2-10725a5af2fa tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:09.834130 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d3e77ead-1f57-4e46-879e-6e6d89e59838 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:09.837825 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-edaa48c8-ca4f-4496-88e2-10725a5af2fa tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:09.852455 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-edaa48c8-ca4f-4496-88e2-10725a5af2fa tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:09.854640 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d3e77ead-1f57-4e46-879e-6e6d89e59838 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:09.856819 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d3e77ead-1f57-4e46-879e-6e6d89e59838 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:09.858776 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-edaa48c8-ca4f-4496-88e2-10725a5af2fa tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:09.859851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d3e77ead-1f57-4e46-879e-6e6d89e59838 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:09.860793 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-edaa48c8-ca4f-4496-88e2-10725a5af2fa tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:09.864299 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d3e77ead-1f57-4e46-879e-6e6d89e59838 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:09.864899 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-edaa48c8-ca4f-4496-88e2-10725a5af2fa tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:10.276632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-edaa48c8-ca4f-4496-88e2-10725a5af2fa tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:10.284744 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-edaa48c8-ca4f-4496-88e2-10725a5af2fa tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.491745 Mar 30 07:16:10.285541 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 43/83] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:09 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:10.291306 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-eda8ef93-0744-44c0-b978-b3f1d612d081 req-ddb5abfd-4bf0-46ad-b13c-3ebc9b3811f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fedaffa-1632-4376-a01c-64b81265770e", "name": "network-vif-plugged", "status": "completed", "tag": "8b69b063-2bbd-4852-b768-a54773d55703"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:10.304391 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-eda8ef93-0744-44c0-b978-b3f1d612d081 req-ddb5abfd-4bf0-46ad-b13c-3ebc9b3811f5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:10.304391 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-eda8ef93-0744-44c0-b978-b3f1d612d081 req-ddb5abfd-4bf0-46ad-b13c-3ebc9b3811f5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:10.312524 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d3e77ead-1f57-4e46-879e-6e6d89e59838 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:10.323772 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d3e77ead-1f57-4e46-879e-6e6d89e59838 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.506133 Mar 30 07:16:10.324831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 41/84] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:09 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:10.346331 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-eda8ef93-0744-44c0-b978-b3f1d612d081 req-ddb5abfd-4bf0-46ad-b13c-3ebc9b3811f5 service nova] Creating event network-vif-plugged:8b69b063-2bbd-4852-b768-a54773d55703 for instance 7fedaffa-1632-4376-a01c-64b81265770e on hv-cinder-83577 Mar 30 07:16:10.351701 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-eda8ef93-0744-44c0-b978-b3f1d612d081 req-ddb5abfd-4bf0-46ad-b13c-3ebc9b3811f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064884 Mar 30 07:16:10.352444 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 44/85] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:16:10.808774 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:10.809721 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:10.821346 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4936a0f7-ef2f-40a8-9710-29fe14168830 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:10.822741 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4936a0f7-ef2f-40a8-9710-29fe14168830 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:10.824419 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:10.825092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:10.826199 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:10.826733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:10.830388 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4936a0f7-ef2f-40a8-9710-29fe14168830 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:10.831785 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4936a0f7-ef2f-40a8-9710-29fe14168830 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:10.832772 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4936a0f7-ef2f-40a8-9710-29fe14168830 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:10.833233 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4936a0f7-ef2f-40a8-9710-29fe14168830 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:11.044285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:11.054093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4936a0f7-ef2f-40a8-9710-29fe14168830 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:11.062771 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4936a0f7-ef2f-40a8-9710-29fe14168830 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1502 microversion: 2.1 time: 0.247941 Mar 30 07:16:11.063530 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:11.063785 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 45/86] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:10 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:11.065829 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:11.068580 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cea4aab8-c4ff-44d3-8ec6-18b1f00ba783 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.264843 Mar 30 07:16:11.069151 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 42/87] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:10 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:11.303078 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2d79dd6e-eeb6-446e-9e5b-823bbfe60410 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:11.306151 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2d79dd6e-eeb6-446e-9e5b-823bbfe60410 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:11.314807 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2d79dd6e-eeb6-446e-9e5b-823bbfe60410 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:11.316137 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2d79dd6e-eeb6-446e-9e5b-823bbfe60410 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:11.317396 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2d79dd6e-eeb6-446e-9e5b-823bbfe60410 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:11.318188 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2d79dd6e-eeb6-446e-9e5b-823bbfe60410 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:11.341607 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-22f26940-9a8b-4c56-83f5-0b4e3026c66e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:11.342343 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-22f26940-9a8b-4c56-83f5-0b4e3026c66e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:11.352785 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-22f26940-9a8b-4c56-83f5-0b4e3026c66e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:11.353316 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-22f26940-9a8b-4c56-83f5-0b4e3026c66e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:11.358033 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-22f26940-9a8b-4c56-83f5-0b4e3026c66e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:11.358665 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-22f26940-9a8b-4c56-83f5-0b4e3026c66e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:11.638097 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2d79dd6e-eeb6-446e-9e5b-823bbfe60410 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:11.647269 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2d79dd6e-eeb6-446e-9e5b-823bbfe60410 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.348857 Mar 30 07:16:11.648237 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 46/88] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:11 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:11.666002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-22f26940-9a8b-4c56-83f5-0b4e3026c66e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:11.675423 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-22f26940-9a8b-4c56-83f5-0b4e3026c66e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.337890 Mar 30 07:16:11.676346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 43/89] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:11 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:12.086761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:12.088059 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:12.094323 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:12.094971 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:12.095838 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:12.096275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:12.239979 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:12.249216 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:12.251203 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:12.252365 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e4c2c47b-e21d-47ae-a5e0-2af53efff9af tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.169693 Mar 30 07:16:12.252936 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 47/90] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:12 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:12.668274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-dbcdd88d-97e0-4eb2-b8b1-7854f0df385f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:12.669689 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-dbcdd88d-97e0-4eb2-b8b1-7854f0df385f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:12.678509 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dbcdd88d-97e0-4eb2-b8b1-7854f0df385f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:12.678953 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dbcdd88d-97e0-4eb2-b8b1-7854f0df385f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:12.679768 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dbcdd88d-97e0-4eb2-b8b1-7854f0df385f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:12.680244 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dbcdd88d-97e0-4eb2-b8b1-7854f0df385f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:12.695956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5ba35f63-2a37-4ad0-aff5-90530eee16b2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:12.697006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5ba35f63-2a37-4ad0-aff5-90530eee16b2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:12.703740 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ba35f63-2a37-4ad0-aff5-90530eee16b2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:12.704294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ba35f63-2a37-4ad0-aff5-90530eee16b2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:12.705728 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ba35f63-2a37-4ad0-aff5-90530eee16b2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:12.706338 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ba35f63-2a37-4ad0-aff5-90530eee16b2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:12.971020 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-dbcdd88d-97e0-4eb2-b8b1-7854f0df385f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:12.978386 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-dbcdd88d-97e0-4eb2-b8b1-7854f0df385f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.315746 Mar 30 07:16:12.978971 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 44/91] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:12 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:13.004147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5ba35f63-2a37-4ad0-aff5-90530eee16b2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:13.011405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5ba35f63-2a37-4ad0-aff5-90530eee16b2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.322608 Mar 30 07:16:13.012020 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 48/92] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:12 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:13.271511 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:13.272149 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:13.278543 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:13.279309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:13.280773 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:13.281388 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:13.437699 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:13.449382 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:13.451594 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:13.452799 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-27ac2b10-3555-4fc3-b0cb-0ffc987f4556 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.185869 Mar 30 07:16:13.453381 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 45/93] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:13 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:13.995720 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9d165aa9-a48c-45e5-ad80-f04946ece06b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:13.996632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9d165aa9-a48c-45e5-ad80-f04946ece06b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:14.002940 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9d165aa9-a48c-45e5-ad80-f04946ece06b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:14.003468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9d165aa9-a48c-45e5-ad80-f04946ece06b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:14.004481 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9d165aa9-a48c-45e5-ad80-f04946ece06b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:14.004988 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9d165aa9-a48c-45e5-ad80-f04946ece06b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:14.032839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d02c0366-457e-4fd6-9054-514f2990de8f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:14.033533 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d02c0366-457e-4fd6-9054-514f2990de8f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:14.045966 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d02c0366-457e-4fd6-9054-514f2990de8f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:14.046488 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d02c0366-457e-4fd6-9054-514f2990de8f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:14.047532 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d02c0366-457e-4fd6-9054-514f2990de8f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:14.048158 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d02c0366-457e-4fd6-9054-514f2990de8f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:14.240541 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9d165aa9-a48c-45e5-ad80-f04946ece06b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:14.253077 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9d165aa9-a48c-45e5-ad80-f04946ece06b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.261214 Mar 30 07:16:14.253703 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 49/94] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:13 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:14.369623 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d02c0366-457e-4fd6-9054-514f2990de8f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:14.380279 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d02c0366-457e-4fd6-9054-514f2990de8f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.355448 Mar 30 07:16:14.381193 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 46/95] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:14 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:14.471924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:14.472592 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:14.483652 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:14.484132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:14.492610 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:14.493062 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:14.657976 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:14.660522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4d4b73e0-2098-4cfd-87e0-91e5f3b20b01 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfa5bef0-c11c-4323-97e2-ef148b037798"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:14.661674 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4d4b73e0-2098-4cfd-87e0-91e5f3b20b01 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:14.671646 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:14.673908 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4d4b73e0-2098-4cfd-87e0-91e5f3b20b01 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:14.674324 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:14.674516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4d4b73e0-2098-4cfd-87e0-91e5f3b20b01 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:14.675344 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4d4b73e0-2098-4cfd-87e0-91e5f3b20b01 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:14.675795 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4d4b73e0-2098-4cfd-87e0-91e5f3b20b01 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:14.677534 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f8928a4d-5b7c-4342-b946-7d9544e3b2d0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.209981 Mar 30 07:16:14.678686 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 50/96] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:14 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:15.069394 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4d4b73e0-2098-4cfd-87e0-91e5f3b20b01 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "POST /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412992 Mar 30 07:16:15.070269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 47/97] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:16:14 2022] POST /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:16:15.270531 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-dde7f398-95ef-4863-9fab-c21854337289 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:15.271550 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-dde7f398-95ef-4863-9fab-c21854337289 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:15.278701 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dde7f398-95ef-4863-9fab-c21854337289 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:15.279288 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dde7f398-95ef-4863-9fab-c21854337289 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:15.280671 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dde7f398-95ef-4863-9fab-c21854337289 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:15.281114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dde7f398-95ef-4863-9fab-c21854337289 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:15.406661 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d9041d42-f011-4ffd-b63c-a4636ebd89a3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:15.407644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d9041d42-f011-4ffd-b63c-a4636ebd89a3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:15.418244 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d9041d42-f011-4ffd-b63c-a4636ebd89a3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:15.419201 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d9041d42-f011-4ffd-b63c-a4636ebd89a3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:15.421023 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d9041d42-f011-4ffd-b63c-a4636ebd89a3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:15.421652 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d9041d42-f011-4ffd-b63c-a4636ebd89a3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:15.480585 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-dde7f398-95ef-4863-9fab-c21854337289 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:15.489867 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-dde7f398-95ef-4863-9fab-c21854337289 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.223406 Mar 30 07:16:15.490534 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 51/98] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:15 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:15.652328 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-19092159-c6d3-4111-b736-4c4baf20fdaf req-0075b59c-b069-44fb-b73a-a40f5535ec14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977a73f-876d-4d10-adf8-326ed77fc467", "name": "network-vif-plugged", "status": "completed", "tag": "46952506-ed7a-47ba-a4d4-3306605e4824"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:15.680627 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-19092159-c6d3-4111-b736-4c4baf20fdaf req-0075b59c-b069-44fb-b73a-a40f5535ec14 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:15.683657 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-19092159-c6d3-4111-b736-4c4baf20fdaf req-0075b59c-b069-44fb-b73a-a40f5535ec14 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:15.689232 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d9041d42-f011-4ffd-b63c-a4636ebd89a3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:15.702408 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d9041d42-f011-4ffd-b63c-a4636ebd89a3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.308332 Mar 30 07:16:15.703208 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:15 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:15.709892 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:15.710719 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:15.711288 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-19092159-c6d3-4111-b736-4c4baf20fdaf req-0075b59c-b069-44fb-b73a-a40f5535ec14 service nova] Creating event network-vif-plugged:46952506-ed7a-47ba-a4d4-3306605e4824 for instance d977a73f-876d-4d10-adf8-326ed77fc467 on hv-cinder-83577 Mar 30 07:16:15.720349 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:15.721172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-19092159-c6d3-4111-b736-4c4baf20fdaf req-0075b59c-b069-44fb-b73a-a40f5535ec14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072617 Mar 30 07:16:15.721362 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:15.722101 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 52/100] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:16:15.722595 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:15.723223 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:16.014108 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:16.029293 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:16.031795 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:16.034831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3d342f8f-bc24-47be-af42-3358065448b6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.329941 Mar 30 07:16:16.036354 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 49/101] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:15 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:16.509958 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-425d4d03-6b8a-443c-8b16-d026c8ad1898 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:16.510721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-425d4d03-6b8a-443c-8b16-d026c8ad1898 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:16.521541 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-425d4d03-6b8a-443c-8b16-d026c8ad1898 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:16.521996 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-425d4d03-6b8a-443c-8b16-d026c8ad1898 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:16.525636 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-425d4d03-6b8a-443c-8b16-d026c8ad1898 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:16.526162 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-425d4d03-6b8a-443c-8b16-d026c8ad1898 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:16.723099 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5ae10dd1-5373-4ec5-b95a-0acdc709851f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:16.725324 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5ae10dd1-5373-4ec5-b95a-0acdc709851f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:16.734365 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5ae10dd1-5373-4ec5-b95a-0acdc709851f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:16.734993 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5ae10dd1-5373-4ec5-b95a-0acdc709851f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:16.736151 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5ae10dd1-5373-4ec5-b95a-0acdc709851f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:16.736736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5ae10dd1-5373-4ec5-b95a-0acdc709851f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:16.766516 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-425d4d03-6b8a-443c-8b16-d026c8ad1898 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:16.773655 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-425d4d03-6b8a-443c-8b16-d026c8ad1898 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.268524 Mar 30 07:16:16.774236 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 53/102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:16 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:16.888629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5ae10dd1-5373-4ec5-b95a-0acdc709851f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:16.896474 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5ae10dd1-5373-4ec5-b95a-0acdc709851f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.181107 Mar 30 07:16:16.897041 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 50/103] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:16 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:17.058188 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:17.059025 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:17.065132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:17.065662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:17.066496 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:17.066987 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:17.219707 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:17.244935 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:17.246815 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:17.248183 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3c704bde-b1e4-43b4-aa16-4a2afaf5b294 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.194129 Mar 30 07:16:17.258505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 54/104] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:17 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:17.745731 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-51be13ea-17a9-4466-b7ad-2315f9f9ba9b req-59f76bca-68c3-4900-b350-94edfa5eed30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d831174-317c-4c6d-b5b7-e01974621585", "name": "network-vif-plugged", "status": "completed", "tag": "2143af28-585c-4f87-adef-e00385fa7b91"}, {"server_uuid": "ea531783-864c-44f2-9311-d1939a112f2b", "name": "network-vif-plugged", "status": "completed", "tag": "cc0a9d6a-7177-46dd-b56e-afefa52539b0"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:17.758181 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-51be13ea-17a9-4466-b7ad-2315f9f9ba9b req-59f76bca-68c3-4900-b350-94edfa5eed30 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:17.758711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-51be13ea-17a9-4466-b7ad-2315f9f9ba9b req-59f76bca-68c3-4900-b350-94edfa5eed30 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:17.771690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-51be13ea-17a9-4466-b7ad-2315f9f9ba9b req-59f76bca-68c3-4900-b350-94edfa5eed30 service nova] Creating event network-vif-plugged:2143af28-585c-4f87-adef-e00385fa7b91 for instance 1d831174-317c-4c6d-b5b7-e01974621585 on hv-cinder-83577 Mar 30 07:16:17.772212 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-51be13ea-17a9-4466-b7ad-2315f9f9ba9b req-59f76bca-68c3-4900-b350-94edfa5eed30 service nova] Creating event network-vif-plugged:cc0a9d6a-7177-46dd-b56e-afefa52539b0 for instance ea531783-864c-44f2-9311-d1939a112f2b on hv-cinder-83577 Mar 30 07:16:17.778806 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-51be13ea-17a9-4466-b7ad-2315f9f9ba9b req-59f76bca-68c3-4900-b350-94edfa5eed30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036600 Mar 30 07:16:17.779403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 51/105] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:16:17.790505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-65cd34b5-dc35-486b-96b5-ca746216c211 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:17.791196 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-65cd34b5-dc35-486b-96b5-ca746216c211 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:17.797395 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65cd34b5-dc35-486b-96b5-ca746216c211 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:17.797918 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65cd34b5-dc35-486b-96b5-ca746216c211 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:17.798732 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65cd34b5-dc35-486b-96b5-ca746216c211 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:17.799182 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65cd34b5-dc35-486b-96b5-ca746216c211 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:17.915467 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-98dce04f-c990-45b8-8bcb-557977c3ee81 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:17.916385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-98dce04f-c990-45b8-8bcb-557977c3ee81 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:17.923065 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-98dce04f-c990-45b8-8bcb-557977c3ee81 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:17.924307 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-98dce04f-c990-45b8-8bcb-557977c3ee81 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:17.925196 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-98dce04f-c990-45b8-8bcb-557977c3ee81 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:17.925732 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-98dce04f-c990-45b8-8bcb-557977c3ee81 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:17.946520 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-65cd34b5-dc35-486b-96b5-ca746216c211 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:17.954176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-65cd34b5-dc35-486b-96b5-ca746216c211 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.167585 Mar 30 07:16:17.955682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 55/106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:17 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:18.080384 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-98dce04f-c990-45b8-8bcb-557977c3ee81 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:18.088246 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-98dce04f-c990-45b8-8bcb-557977c3ee81 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.177957 Mar 30 07:16:18.088824 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 52/107] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:17 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:18.265952 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:18.266549 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:18.272772 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:18.273218 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:18.273988 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:18.274421 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:18.414295 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:18.422592 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:18.424107 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:18.425220 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4d71207a-bc14-44e7-a325-c45bd2effba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.163187 Mar 30 07:16:18.425768 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 56/108] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:18 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:18.972449 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4708dece-0862-4159-ad76-0fa43aacca93 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:18.973025 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4708dece-0862-4159-ad76-0fa43aacca93 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:18.979869 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4708dece-0862-4159-ad76-0fa43aacca93 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:18.980320 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4708dece-0862-4159-ad76-0fa43aacca93 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:18.981522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4708dece-0862-4159-ad76-0fa43aacca93 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:18.981958 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4708dece-0862-4159-ad76-0fa43aacca93 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:19.105946 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fc43872b-8fbb-4412-ae5a-2d5928697e1e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:19.107098 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fc43872b-8fbb-4412-ae5a-2d5928697e1e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:19.112960 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fc43872b-8fbb-4412-ae5a-2d5928697e1e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:19.113478 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fc43872b-8fbb-4412-ae5a-2d5928697e1e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:19.114404 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fc43872b-8fbb-4412-ae5a-2d5928697e1e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:19.114891 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fc43872b-8fbb-4412-ae5a-2d5928697e1e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:19.127756 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4708dece-0862-4159-ad76-0fa43aacca93 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:19.135639 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4708dece-0862-4159-ad76-0fa43aacca93 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.167305 Mar 30 07:16:19.136261 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 53/109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:18 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:19.250075 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fc43872b-8fbb-4412-ae5a-2d5928697e1e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:19.257876 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fc43872b-8fbb-4412-ae5a-2d5928697e1e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.155898 Mar 30 07:16:19.258455 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 57/110] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:19 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:19.442690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:19.443430 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:19.449461 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:19.450271 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:19.451038 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:19.451471 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:19.607521 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:19.618088 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:19.619942 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:19.621432 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0402774b-6976-4152-9246-67dfc80893c1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.182726 Mar 30 07:16:19.622651 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 54/111] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:19 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:20.152558 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5499b82b-0ced-4637-a570-58759202fc7b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:20.153510 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5499b82b-0ced-4637-a570-58759202fc7b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:20.159752 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5499b82b-0ced-4637-a570-58759202fc7b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:20.160230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5499b82b-0ced-4637-a570-58759202fc7b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:20.160999 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5499b82b-0ced-4637-a570-58759202fc7b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:20.161412 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5499b82b-0ced-4637-a570-58759202fc7b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:20.275151 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-da1047aa-e4d9-49db-a5d8-85d4cde231ec tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:20.275937 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-da1047aa-e4d9-49db-a5d8-85d4cde231ec tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:20.282875 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-da1047aa-e4d9-49db-a5d8-85d4cde231ec tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:20.283450 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-da1047aa-e4d9-49db-a5d8-85d4cde231ec tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:20.284345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-da1047aa-e4d9-49db-a5d8-85d4cde231ec tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:20.284991 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-da1047aa-e4d9-49db-a5d8-85d4cde231ec tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:20.311349 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5499b82b-0ced-4637-a570-58759202fc7b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:20.323952 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5499b82b-0ced-4637-a570-58759202fc7b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.170989 Mar 30 07:16:20.324877 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 58/112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:20 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:20.443010 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-da1047aa-e4d9-49db-a5d8-85d4cde231ec tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:20.450555 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-da1047aa-e4d9-49db-a5d8-85d4cde231ec tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.179554 Mar 30 07:16:20.451251 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 55/113] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:20 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:20.640064 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:20.640838 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:20.647418 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:20.647928 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:20.648698 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:20.649127 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:20.805342 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:20.815426 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:20.817014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:20.818071 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-392ee111-9210-4b8a-9a54-9c3173b9cbce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1406 microversion: 2.20 time: 0.182064 Mar 30 07:16:20.818644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 59/114] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:20 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:21.342089 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3ae897b6-2c9e-497c-beee-5726046e0a02 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:21.343498 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3ae897b6-2c9e-497c-beee-5726046e0a02 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:21.364860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3ae897b6-2c9e-497c-beee-5726046e0a02 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:21.365312 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3ae897b6-2c9e-497c-beee-5726046e0a02 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:21.366087 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3ae897b6-2c9e-497c-beee-5726046e0a02 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:21.366733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3ae897b6-2c9e-497c-beee-5726046e0a02 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:21.467833 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7b53e559-d85e-414c-b5b5-a1544d52a621 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:21.468476 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7b53e559-d85e-414c-b5b5-a1544d52a621 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:21.482204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7b53e559-d85e-414c-b5b5-a1544d52a621 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:21.483206 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7b53e559-d85e-414c-b5b5-a1544d52a621 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:21.484551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7b53e559-d85e-414c-b5b5-a1544d52a621 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:21.485338 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7b53e559-d85e-414c-b5b5-a1544d52a621 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:21.623643 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3ae897b6-2c9e-497c-beee-5726046e0a02 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:21.631937 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3ae897b6-2c9e-497c-beee-5726046e0a02 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1363 microversion: 2.1 time: 0.293689 Mar 30 07:16:21.632891 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 56/115] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:21 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:21.699107 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7b53e559-d85e-414c-b5b5-a1544d52a621 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:21.707115 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7b53e559-d85e-414c-b5b5-a1544d52a621 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1321 microversion: 2.1 time: 0.243798 Mar 30 07:16:21.708118 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 60/116] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:21 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:21.838126 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:21.838738 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:21.850502 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:21.850952 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:21.851756 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:21.852307 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:22.064286 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:22.073227 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:22.074956 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:22.080092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e55b0a96-b8dc-4d39-a4ba-a447bd9a84dd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1598 microversion: 2.20 time: 0.242284 Mar 30 07:16:22.080808 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 57/117] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:16:21 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1598 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:16:22.102638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-df89611b-c8e1-44ba-ab6d-189499b8f857 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:22.103135 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-df89611b-c8e1-44ba-ab6d-189499b8f857 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:22.122726 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-df89611b-c8e1-44ba-ab6d-189499b8f857 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:22.123282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-df89611b-c8e1-44ba-ab6d-189499b8f857 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:22.124196 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-df89611b-c8e1-44ba-ab6d-189499b8f857 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:22.124769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-df89611b-c8e1-44ba-ab6d-189499b8f857 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:22.268690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-df89611b-c8e1-44ba-ab6d-189499b8f857 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.169922 Mar 30 07:16:22.269605 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 61/118] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Mar 30 07:16:22 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:16:22.650310 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-834de5bd-590c-4553-8467-10e0aa91c8b8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:22.651634 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-834de5bd-590c-4553-8467-10e0aa91c8b8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:22.660394 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-834de5bd-590c-4553-8467-10e0aa91c8b8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:22.661163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-834de5bd-590c-4553-8467-10e0aa91c8b8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:22.662612 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-834de5bd-590c-4553-8467-10e0aa91c8b8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:22.663263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-834de5bd-590c-4553-8467-10e0aa91c8b8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:22.724775 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-945f1fed-3a22-4b03-8d9f-86dbe7d40696 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:22.726258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-945f1fed-3a22-4b03-8d9f-86dbe7d40696 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:22.736204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-945f1fed-3a22-4b03-8d9f-86dbe7d40696 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:22.736980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-945f1fed-3a22-4b03-8d9f-86dbe7d40696 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:22.738012 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-945f1fed-3a22-4b03-8d9f-86dbe7d40696 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:22.738586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-945f1fed-3a22-4b03-8d9f-86dbe7d40696 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:23.492589 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-834de5bd-590c-4553-8467-10e0aa91c8b8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:23.503433 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-834de5bd-590c-4553-8467-10e0aa91c8b8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1550 microversion: 2.1 time: 0.856042 Mar 30 07:16:23.505977 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 58/119] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:22 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1550 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:23.524560 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-273b96e0-b378-4234-bfad-7c66592e06fb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:23.525220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-273b96e0-b378-4234-bfad-7c66592e06fb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:23.531533 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-273b96e0-b378-4234-bfad-7c66592e06fb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:23.533307 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-273b96e0-b378-4234-bfad-7c66592e06fb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:23.540551 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-273b96e0-b378-4234-bfad-7c66592e06fb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:23.540812 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-273b96e0-b378-4234-bfad-7c66592e06fb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:23.678876 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-945f1fed-3a22-4b03-8d9f-86dbe7d40696 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:23.691955 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-945f1fed-3a22-4b03-8d9f-86dbe7d40696 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1515 microversion: 2.1 time: 0.969534 Mar 30 07:16:23.695913 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 62/120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:22 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1515 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:23.713581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-273b96e0-b378-4234-bfad-7c66592e06fb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192883 Mar 30 07:16:23.715196 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 59/121] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Mar 30 07:16:23 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:16:23.726337 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ac022764-19c6-4faf-a2ab-ae980c3f3882 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:23.727824 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ac022764-19c6-4faf-a2ab-ae980c3f3882 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:23.743708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ac022764-19c6-4faf-a2ab-ae980c3f3882 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:23.743708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ac022764-19c6-4faf-a2ab-ae980c3f3882 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:23.743708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ac022764-19c6-4faf-a2ab-ae980c3f3882 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:23.743708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ac022764-19c6-4faf-a2ab-ae980c3f3882 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:23.798262 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-ac022764-19c6-4faf-a2ab-ae980c3f3882 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lazy-loading 'flavor' on Instance uuid 1d831174-317c-4c6d-b5b7-e01974621585 {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:16:23.969156 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ac022764-19c6-4faf-a2ab-ae980c3f3882 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585/action" status: 200 len: 32 microversion: 2.1 time: 0.251405 Mar 30 07:16:23.969794 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 63/122] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:16:23 2022] POST /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 30 07:16:23.988084 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cdf33a2a-3730-4919-955c-dba27deeb873 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:23.988923 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cdf33a2a-3730-4919-955c-dba27deeb873 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:24.000362 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cdf33a2a-3730-4919-955c-dba27deeb873 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:24.001551 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cdf33a2a-3730-4919-955c-dba27deeb873 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:24.002515 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cdf33a2a-3730-4919-955c-dba27deeb873 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:24.003095 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cdf33a2a-3730-4919-955c-dba27deeb873 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:24.460222 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cdf33a2a-3730-4919-955c-dba27deeb873 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:24.471168 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cdf33a2a-3730-4919-955c-dba27deeb873 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.488320 Mar 30 07:16:24.471765 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 60/123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:23 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:25.072127 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-b246497c-465c-48d8-a14c-d4fca0fe242b req-bffc14a2-a568-43e6-9f29-f204827ab162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d977a73f-876d-4d10-adf8-326ed77fc467", "tag": "46952506-ed7a-47ba-a4d4-3306605e4824"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:25.085814 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-b246497c-465c-48d8-a14c-d4fca0fe242b req-bffc14a2-a568-43e6-9f29-f204827ab162 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:25.086251 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-b246497c-465c-48d8-a14c-d4fca0fe242b req-bffc14a2-a568-43e6-9f29-f204827ab162 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:25.112401 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-b246497c-465c-48d8-a14c-d4fca0fe242b req-bffc14a2-a568-43e6-9f29-f204827ab162 service nova] Creating event network-changed:46952506-ed7a-47ba-a4d4-3306605e4824 for instance d977a73f-876d-4d10-adf8-326ed77fc467 on hv-cinder-83577 Mar 30 07:16:25.123687 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-b246497c-465c-48d8-a14c-d4fca0fe242b req-bffc14a2-a568-43e6-9f29-f204827ab162 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056540 Mar 30 07:16:25.123687 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 64/124] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:16:25.489516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-135b7c34-c3ba-41eb-a4af-971402488c66 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:25.490136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-135b7c34-c3ba-41eb-a4af-971402488c66 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:25.512183 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-135b7c34-c3ba-41eb-a4af-971402488c66 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:25.515752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-135b7c34-c3ba-41eb-a4af-971402488c66 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:25.517409 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-135b7c34-c3ba-41eb-a4af-971402488c66 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:25.517926 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-135b7c34-c3ba-41eb-a4af-971402488c66 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:25.918149 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-135b7c34-c3ba-41eb-a4af-971402488c66 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:25.931073 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-135b7c34-c3ba-41eb-a4af-971402488c66 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.446331 Mar 30 07:16:25.932637 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 61/125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:25 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:26.955011 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e5370b4d-207a-42d5-b645-3461c351afcf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:26.956574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e5370b4d-207a-42d5-b645-3461c351afcf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:26.964080 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e5370b4d-207a-42d5-b645-3461c351afcf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:26.978049 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e5370b4d-207a-42d5-b645-3461c351afcf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:26.980188 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e5370b4d-207a-42d5-b645-3461c351afcf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:26.980870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e5370b4d-207a-42d5-b645-3461c351afcf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:27.193019 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-8007d708-8217-4b96-9206-f6370f5c11d2 req-b455c712-bff2-46c3-b004-6f620cb6b426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea531783-864c-44f2-9311-d1939a112f2b", "tag": "cc0a9d6a-7177-46dd-b56e-afefa52539b0"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:27.216657 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-8007d708-8217-4b96-9206-f6370f5c11d2 req-b455c712-bff2-46c3-b004-6f620cb6b426 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:27.217107 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-8007d708-8217-4b96-9206-f6370f5c11d2 req-b455c712-bff2-46c3-b004-6f620cb6b426 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:27.239677 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e5370b4d-207a-42d5-b645-3461c351afcf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:27.244456 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-8007d708-8217-4b96-9206-f6370f5c11d2 req-b455c712-bff2-46c3-b004-6f620cb6b426 service nova] Creating event network-changed:cc0a9d6a-7177-46dd-b56e-afefa52539b0 for instance ea531783-864c-44f2-9311-d1939a112f2b on hv-cinder-83577 Mar 30 07:16:27.249643 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e5370b4d-207a-42d5-b645-3461c351afcf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.301786 Mar 30 07:16:27.251649 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 65/126] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:26 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:27.258387 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-8007d708-8217-4b96-9206-f6370f5c11d2 req-b455c712-bff2-46c3-b004-6f620cb6b426 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069345 Mar 30 07:16:27.267055 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 62/127] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:16:28.195736 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fecf1d7e-f40d-4885-930c-02b5cf5a1f32 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:28.196339 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fecf1d7e-f40d-4885-930c-02b5cf5a1f32 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:28.203745 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fecf1d7e-f40d-4885-930c-02b5cf5a1f32 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:28.204270 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fecf1d7e-f40d-4885-930c-02b5cf5a1f32 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:28.205082 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fecf1d7e-f40d-4885-930c-02b5cf5a1f32 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:28.205501 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fecf1d7e-f40d-4885-930c-02b5cf5a1f32 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:28.232768 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fecf1d7e-f40d-4885-930c-02b5cf5a1f32 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:16:28.268345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ffbb9029-36d6-4c1d-8261-3693737702a1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:28.269128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ffbb9029-36d6-4c1d-8261-3693737702a1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:28.276376 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ffbb9029-36d6-4c1d-8261-3693737702a1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:28.276854 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ffbb9029-36d6-4c1d-8261-3693737702a1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:28.277642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ffbb9029-36d6-4c1d-8261-3693737702a1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:28.278412 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ffbb9029-36d6-4c1d-8261-3693737702a1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:28.325340 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fecf1d7e-f40d-4885-930c-02b5cf5a1f32 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 204 len: 0 microversion: 2.1 time: 0.134965 Mar 30 07:16:28.325964 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 66/128] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:16:28 2022] DELETE /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:16:28.335114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-aa793548-4551-4770-bb27-65db03e75ef2 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:28.335703 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-aa793548-4551-4770-bb27-65db03e75ef2 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:28.342800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-aa793548-4551-4770-bb27-65db03e75ef2 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:28.343460 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-aa793548-4551-4770-bb27-65db03e75ef2 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:28.344486 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-aa793548-4551-4770-bb27-65db03e75ef2 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:28.344924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-aa793548-4551-4770-bb27-65db03e75ef2 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:28.475372 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ffbb9029-36d6-4c1d-8261-3693737702a1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:28.484024 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ffbb9029-36d6-4c1d-8261-3693737702a1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.219920 Mar 30 07:16:28.484666 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 63/129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:28 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:28.522724 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-aa793548-4551-4770-bb27-65db03e75ef2 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:28.532406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-aa793548-4551-4770-bb27-65db03e75ef2 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1554 microversion: 2.1 time: 0.202163 Mar 30 07:16:28.532988 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 67/130] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:28 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:29.504142 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3eb0c7e5-56bf-4ec8-874f-d0837659c245 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:29.504836 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3eb0c7e5-56bf-4ec8-874f-d0837659c245 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:29.511601 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3eb0c7e5-56bf-4ec8-874f-d0837659c245 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:29.512127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3eb0c7e5-56bf-4ec8-874f-d0837659c245 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:29.513176 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3eb0c7e5-56bf-4ec8-874f-d0837659c245 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:29.513611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3eb0c7e5-56bf-4ec8-874f-d0837659c245 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:29.550675 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ee04c85a-8dfd-49b6-aeb4-3d8c06c6ade9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:29.551356 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ee04c85a-8dfd-49b6-aeb4-3d8c06c6ade9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:29.557560 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ee04c85a-8dfd-49b6-aeb4-3d8c06c6ade9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:29.558111 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ee04c85a-8dfd-49b6-aeb4-3d8c06c6ade9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:29.558924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ee04c85a-8dfd-49b6-aeb4-3d8c06c6ade9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:29.559621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ee04c85a-8dfd-49b6-aeb4-3d8c06c6ade9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:29.732742 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3eb0c7e5-56bf-4ec8-874f-d0837659c245 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:29.740713 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3eb0c7e5-56bf-4ec8-874f-d0837659c245 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.241818 Mar 30 07:16:29.741360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 64/131] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:29 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:29.762615 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ee04c85a-8dfd-49b6-aeb4-3d8c06c6ade9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:29.770875 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ee04c85a-8dfd-49b6-aeb4-3d8c06c6ade9 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1554 microversion: 2.1 time: 0.224044 Mar 30 07:16:29.771450 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 68/132] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:29 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:30.758797 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6f104d4d-4989-4d16-95f8-a1609c86da5c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:30.759394 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6f104d4d-4989-4d16-95f8-a1609c86da5c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:30.766343 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6f104d4d-4989-4d16-95f8-a1609c86da5c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:30.766791 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6f104d4d-4989-4d16-95f8-a1609c86da5c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:30.767547 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6f104d4d-4989-4d16-95f8-a1609c86da5c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:30.768048 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6f104d4d-4989-4d16-95f8-a1609c86da5c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:30.788300 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-85a65bc6-97de-4fcc-993b-a508394b2de3 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:30.788858 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-85a65bc6-97de-4fcc-993b-a508394b2de3 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:30.795446 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-85a65bc6-97de-4fcc-993b-a508394b2de3 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:30.795926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-85a65bc6-97de-4fcc-993b-a508394b2de3 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:30.796703 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-85a65bc6-97de-4fcc-993b-a508394b2de3 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:30.797192 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-85a65bc6-97de-4fcc-993b-a508394b2de3 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:30.965960 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6f104d4d-4989-4d16-95f8-a1609c86da5c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:30.986102 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6f104d4d-4989-4d16-95f8-a1609c86da5c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.231117 Mar 30 07:16:30.986773 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 65/133] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:30 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:30.990211 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-85a65bc6-97de-4fcc-993b-a508394b2de3 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:30.998747 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-85a65bc6-97de-4fcc-993b-a508394b2de3 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1554 microversion: 2.1 time: 0.214293 Mar 30 07:16:30.999300 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 69/134] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:30 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:32.003247 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3f580138-1a76-48d8-b552-ca795731801a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:32.003895 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3f580138-1a76-48d8-b552-ca795731801a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:32.010642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3f580138-1a76-48d8-b552-ca795731801a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:32.011151 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3f580138-1a76-48d8-b552-ca795731801a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:32.011985 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3f580138-1a76-48d8-b552-ca795731801a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:32.012875 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3f580138-1a76-48d8-b552-ca795731801a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:32.015506 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-13b7a3d3-616b-4142-822f-93423e0d19be tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:32.016244 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-13b7a3d3-616b-4142-822f-93423e0d19be tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:32.022608 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-13b7a3d3-616b-4142-822f-93423e0d19be tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:32.023057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-13b7a3d3-616b-4142-822f-93423e0d19be tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:32.023839 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-13b7a3d3-616b-4142-822f-93423e0d19be tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:32.024309 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-13b7a3d3-616b-4142-822f-93423e0d19be tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:32.220198 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3f580138-1a76-48d8-b552-ca795731801a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:32.223578 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-13b7a3d3-616b-4142-822f-93423e0d19be tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:32.228115 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3f580138-1a76-48d8-b552-ca795731801a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.229096 Mar 30 07:16:32.228663 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 66/135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:31 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:32.232112 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-13b7a3d3-616b-4142-822f-93423e0d19be tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1554 microversion: 2.1 time: 0.220942 Mar 30 07:16:32.239550 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 70/136] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:32 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:33.246094 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-277f4a87-15bb-4892-8fa5-8454fea5380e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:33.246743 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-277f4a87-15bb-4892-8fa5-8454fea5380e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:33.248806 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5e6802c8-82b7-4496-8215-ffec713d8c86 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:33.249429 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5e6802c8-82b7-4496-8215-ffec713d8c86 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:33.254120 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-277f4a87-15bb-4892-8fa5-8454fea5380e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:33.254574 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-277f4a87-15bb-4892-8fa5-8454fea5380e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:33.255348 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-277f4a87-15bb-4892-8fa5-8454fea5380e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:33.255484 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5e6802c8-82b7-4496-8215-ffec713d8c86 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:33.255783 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-277f4a87-15bb-4892-8fa5-8454fea5380e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:33.255975 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5e6802c8-82b7-4496-8215-ffec713d8c86 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:33.256756 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5e6802c8-82b7-4496-8215-ffec713d8c86 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:33.257176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5e6802c8-82b7-4496-8215-ffec713d8c86 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:33.459136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-277f4a87-15bb-4892-8fa5-8454fea5380e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:33.466845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5e6802c8-82b7-4496-8215-ffec713d8c86 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:33.467740 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-277f4a87-15bb-4892-8fa5-8454fea5380e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.225428 Mar 30 07:16:33.468413 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 67/137] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:33 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:33.472406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5e6802c8-82b7-4496-8215-ffec713d8c86 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1554 microversion: 2.1 time: 0.227378 Mar 30 07:16:33.473005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 71/138] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:33 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:34.485963 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-563783e9-8eba-440c-b9fc-a23352ef6408 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:34.486660 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-563783e9-8eba-440c-b9fc-a23352ef6408 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:34.490892 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5a08c5cb-7eb7-4523-965c-a97ec216cb5a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:34.492141 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5a08c5cb-7eb7-4523-965c-a97ec216cb5a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:34.493758 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-563783e9-8eba-440c-b9fc-a23352ef6408 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:34.494300 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-563783e9-8eba-440c-b9fc-a23352ef6408 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:34.495041 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-563783e9-8eba-440c-b9fc-a23352ef6408 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:34.495630 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-563783e9-8eba-440c-b9fc-a23352ef6408 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:34.499246 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a08c5cb-7eb7-4523-965c-a97ec216cb5a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:34.499695 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a08c5cb-7eb7-4523-965c-a97ec216cb5a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:34.500501 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a08c5cb-7eb7-4523-965c-a97ec216cb5a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:34.500935 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a08c5cb-7eb7-4523-965c-a97ec216cb5a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:34.695801 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-563783e9-8eba-440c-b9fc-a23352ef6408 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:34.704549 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-563783e9-8eba-440c-b9fc-a23352ef6408 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.223014 Mar 30 07:16:34.713915 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 68/139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:34 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:34.714176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5a08c5cb-7eb7-4523-965c-a97ec216cb5a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:34.715664 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5a08c5cb-7eb7-4523-965c-a97ec216cb5a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1554 microversion: 2.1 time: 0.229419 Mar 30 07:16:34.716420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 72/140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:34 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:35.721879 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-729c73c4-5f6a-4a5d-9be9-b4a02572b12d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:35.722492 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-729c73c4-5f6a-4a5d-9be9-b4a02572b12d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:35.729318 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-729c73c4-5f6a-4a5d-9be9-b4a02572b12d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:35.729769 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-729c73c4-5f6a-4a5d-9be9-b4a02572b12d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:35.730529 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-729c73c4-5f6a-4a5d-9be9-b4a02572b12d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:35.730958 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-729c73c4-5f6a-4a5d-9be9-b4a02572b12d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:35.733722 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-20eaaa44-e294-49fb-a38c-3b2d70d43ba1 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:35.734490 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-20eaaa44-e294-49fb-a38c-3b2d70d43ba1 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:35.740553 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-20eaaa44-e294-49fb-a38c-3b2d70d43ba1 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:35.740994 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-20eaaa44-e294-49fb-a38c-3b2d70d43ba1 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:35.741752 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-20eaaa44-e294-49fb-a38c-3b2d70d43ba1 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:35.742179 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-20eaaa44-e294-49fb-a38c-3b2d70d43ba1 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:35.932032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-20eaaa44-e294-49fb-a38c-3b2d70d43ba1 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:35.942812 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-20eaaa44-e294-49fb-a38c-3b2d70d43ba1 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1554 microversion: 2.1 time: 0.213483 Mar 30 07:16:35.943677 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:35 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:35.948990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-729c73c4-5f6a-4a5d-9be9-b4a02572b12d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:35.957449 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-729c73c4-5f6a-4a5d-9be9-b4a02572b12d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.239488 Mar 30 07:16:35.957943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 69/142] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:35 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:36.963990 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c42186d1-5712-4020-a495-bec0f2dda3cd tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:36.964975 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c42186d1-5712-4020-a495-bec0f2dda3cd tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:36.975489 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c42186d1-5712-4020-a495-bec0f2dda3cd tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:36.976362 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c42186d1-5712-4020-a495-bec0f2dda3cd tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:36.977634 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c42186d1-5712-4020-a495-bec0f2dda3cd tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:36.978353 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c42186d1-5712-4020-a495-bec0f2dda3cd tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:36.978572 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1fa365d5-feae-49ee-bb0f-06f7c3b146f6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:36.980010 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1fa365d5-feae-49ee-bb0f-06f7c3b146f6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:36.989330 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1fa365d5-feae-49ee-bb0f-06f7c3b146f6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:36.989768 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1fa365d5-feae-49ee-bb0f-06f7c3b146f6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:36.990557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1fa365d5-feae-49ee-bb0f-06f7c3b146f6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:36.991026 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1fa365d5-feae-49ee-bb0f-06f7c3b146f6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:37.179513 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c42186d1-5712-4020-a495-bec0f2dda3cd tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:37.187432 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c42186d1-5712-4020-a495-bec0f2dda3cd tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1554 microversion: 2.1 time: 0.229924 Mar 30 07:16:37.188332 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 74/143] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:36 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:37.191651 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1fa365d5-feae-49ee-bb0f-06f7c3b146f6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:37.199995 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1fa365d5-feae-49ee-bb0f-06f7c3b146f6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.227902 Mar 30 07:16:37.200557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 70/144] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:36 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:38.150935 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-7b2beaa8-5017-4b55-8011-69445daf54ab req-0015a59c-2ddb-4385-8321-e1cdbb62afe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e395dc-f645-44ef-a69c-b609fcfb7c13", "name": "network-vif-deleted", "tag": "83614a76-4b14-423b-938c-f966a668f09c"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:38.159099 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-7b2beaa8-5017-4b55-8011-69445daf54ab req-0015a59c-2ddb-4385-8321-e1cdbb62afe8 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:38.159531 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-7b2beaa8-5017-4b55-8011-69445daf54ab req-0015a59c-2ddb-4385-8321-e1cdbb62afe8 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:38.170462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-7b2beaa8-5017-4b55-8011-69445daf54ab req-0015a59c-2ddb-4385-8321-e1cdbb62afe8 service nova] Creating event network-vif-deleted:83614a76-4b14-423b-938c-f966a668f09c for instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 on hv-cinder-83577 Mar 30 07:16:38.176186 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-7b2beaa8-5017-4b55-8011-69445daf54ab req-0015a59c-2ddb-4385-8321-e1cdbb62afe8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028656 Mar 30 07:16:38.177385 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 75/145] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:16:38.204577 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6ea1dbac-fc0a-4dab-96c6-856a038135df tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:38.205291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6ea1dbac-fc0a-4dab-96c6-856a038135df tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:38.212332 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6ea1dbac-fc0a-4dab-96c6-856a038135df tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:38.212769 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6ea1dbac-fc0a-4dab-96c6-856a038135df tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:38.213846 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6ea1dbac-fc0a-4dab-96c6-856a038135df tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:38.214279 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6ea1dbac-fc0a-4dab-96c6-856a038135df tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:38.217687 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-8af0c737-5010-473e-971f-e6c9707f705e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:38.218559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-8af0c737-5010-473e-971f-e6c9707f705e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:38.225002 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8af0c737-5010-473e-971f-e6c9707f705e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:38.225632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8af0c737-5010-473e-971f-e6c9707f705e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:38.226554 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8af0c737-5010-473e-971f-e6c9707f705e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:38.227286 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8af0c737-5010-473e-971f-e6c9707f705e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:38.289402 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6ea1dbac-fc0a-4dab-96c6-856a038135df tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:38.297740 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6ea1dbac-fc0a-4dab-96c6-856a038135df tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1512 microversion: 2.1 time: 0.096943 Mar 30 07:16:38.298603 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 71/146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:38 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:38.382821 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-8af0c737-5010-473e-971f-e6c9707f705e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:38.390363 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-8af0c737-5010-473e-971f-e6c9707f705e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.177280 Mar 30 07:16:38.390930 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 76/147] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:38 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:39.315613 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f479634e-33d9-4c24-b16c-619b87220559 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:39.316397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f479634e-33d9-4c24-b16c-619b87220559 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:39.324061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f479634e-33d9-4c24-b16c-619b87220559 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:39.324585 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f479634e-33d9-4c24-b16c-619b87220559 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:39.325470 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f479634e-33d9-4c24-b16c-619b87220559 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:39.325971 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f479634e-33d9-4c24-b16c-619b87220559 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:39.386693 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f479634e-33d9-4c24-b16c-619b87220559 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:39.394775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f479634e-33d9-4c24-b16c-619b87220559 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1512 microversion: 2.1 time: 0.083739 Mar 30 07:16:39.395572 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 72/148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:39 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1512 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:39.409187 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-00c7d38f-0222-4566-874d-fb569bfafecd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:39.409806 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-00c7d38f-0222-4566-874d-fb569bfafecd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:39.415546 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-00c7d38f-0222-4566-874d-fb569bfafecd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:39.416026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-00c7d38f-0222-4566-874d-fb569bfafecd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:39.416786 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-00c7d38f-0222-4566-874d-fb569bfafecd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:39.417210 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-00c7d38f-0222-4566-874d-fb569bfafecd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:39.548120 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-00c7d38f-0222-4566-874d-fb569bfafecd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:39.556560 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-00c7d38f-0222-4566-874d-fb569bfafecd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.151334 Mar 30 07:16:39.557127 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 77/149] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:39 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:40.413270 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-13d49f36-0ce3-4c57-a0f9-c61ae92fd9bb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:40.413877 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-13d49f36-0ce3-4c57-a0f9-c61ae92fd9bb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:40.420807 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13d49f36-0ce3-4c57-a0f9-c61ae92fd9bb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:40.421275 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13d49f36-0ce3-4c57-a0f9-c61ae92fd9bb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:40.422037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13d49f36-0ce3-4c57-a0f9-c61ae92fd9bb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:40.422460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13d49f36-0ce3-4c57-a0f9-c61ae92fd9bb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:40.486811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-13d49f36-0ce3-4c57-a0f9-c61ae92fd9bb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:40.495338 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-13d49f36-0ce3-4c57-a0f9-c61ae92fd9bb tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1346 microversion: 2.1 time: 0.086076 Mar 30 07:16:40.495977 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 73/150] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:40 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:40.577673 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4dcb32a8-1c6a-488e-99a4-9ffb1615f220 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:40.578649 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4dcb32a8-1c6a-488e-99a4-9ffb1615f220 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:40.588934 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4dcb32a8-1c6a-488e-99a4-9ffb1615f220 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:40.589665 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4dcb32a8-1c6a-488e-99a4-9ffb1615f220 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:40.590905 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4dcb32a8-1c6a-488e-99a4-9ffb1615f220 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:40.591609 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4dcb32a8-1c6a-488e-99a4-9ffb1615f220 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:40.733938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4dcb32a8-1c6a-488e-99a4-9ffb1615f220 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:40.741724 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4dcb32a8-1c6a-488e-99a4-9ffb1615f220 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.170513 Mar 30 07:16:40.742317 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 78/151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:40 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:41.512804 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f4d4844e-ed6b-4257-8e48-dc55b9f5fe0a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:41.513415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f4d4844e-ed6b-4257-8e48-dc55b9f5fe0a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:41.520399 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f4d4844e-ed6b-4257-8e48-dc55b9f5fe0a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:41.520851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f4d4844e-ed6b-4257-8e48-dc55b9f5fe0a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:41.521624 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f4d4844e-ed6b-4257-8e48-dc55b9f5fe0a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:41.522056 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f4d4844e-ed6b-4257-8e48-dc55b9f5fe0a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:41.585405 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f4d4844e-ed6b-4257-8e48-dc55b9f5fe0a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd766a95dfb444e6c95d1111d933cdd83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad704701fcba49e5adc45e451291ef71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:41.596549 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f4d4844e-ed6b-4257-8e48-dc55b9f5fe0a tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 200 len: 1346 microversion: 2.1 time: 0.087705 Mar 30 07:16:41.597294 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 74/152] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:41 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:41.759200 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e4e24674-c201-47c3-9dc9-4ea6b429c893 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:41.761745 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e4e24674-c201-47c3-9dc9-4ea6b429c893 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:41.767837 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4e24674-c201-47c3-9dc9-4ea6b429c893 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:41.768305 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4e24674-c201-47c3-9dc9-4ea6b429c893 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:41.769233 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4e24674-c201-47c3-9dc9-4ea6b429c893 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:41.769668 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4e24674-c201-47c3-9dc9-4ea6b429c893 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:41.920859 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e4e24674-c201-47c3-9dc9-4ea6b429c893 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:41.923018 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e4e24674-c201-47c3-9dc9-4ea6b429c893 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.168468 Mar 30 07:16:41.923620 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 79/153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:41 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:42.614842 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:42.615538 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:42.621872 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:42.622322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:42.623100 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:42.623552 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:42.637716 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] HTTP exception thrown: Instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 could not be found. Mar 30 07:16:42.638319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Returning 404 to user: Instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:16:42.639154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6c21b936-131c-4913-9146-3c3e1b0024bf tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 404 len: 111 microversion: 2.1 time: 0.028791 Mar 30 07:16:42.639968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 75/154] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:42 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:16:42.745826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:42.746745 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:42.752493 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:42.752937 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:42.753686 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:42.754143 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:42.767025 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] HTTP exception thrown: Instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 could not be found. Mar 30 07:16:42.767694 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Returning 404 to user: Instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:16:42.768890 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ce2b7a45-dc49-4419-91b8-61fdd18b5884 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026905 Mar 30 07:16:42.769645 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 80/155] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:16:42 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:16:42.940591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-16575c51-aff7-442e-adbd-69843609d860 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:42.941213 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-16575c51-aff7-442e-adbd-69843609d860 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:42.947335 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-16575c51-aff7-442e-adbd-69843609d860 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:42.947788 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-16575c51-aff7-442e-adbd-69843609d860 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:42.948590 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-16575c51-aff7-442e-adbd-69843609d860 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:42.949036 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-16575c51-aff7-442e-adbd-69843609d860 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:43.084002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-16575c51-aff7-442e-adbd-69843609d860 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:43.091392 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-16575c51-aff7-442e-adbd-69843609d860 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.154819 Mar 30 07:16:43.091967 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 76/156] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:42 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:43.985406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:43.985959 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:43.993227 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:43.993749 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:43.994580 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:43.995096 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:44.008778 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] HTTP exception thrown: Instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 could not be found. Mar 30 07:16:44.009413 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Returning 404 to user: Instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:16:44.010322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7d030bb1-de20-44ab-850e-d4a6c1bf1ad0 tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 404 len: 111 microversion: 2.1 time: 0.030358 Mar 30 07:16:44.010926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 81/157] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:16:43 2022] DELETE /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:16:44.027828 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:44.028612 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] [instance: b4e395dc-f645-44ef-a69c-b609fcfb7c13] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:44.037233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:44.037233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:44.037233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:44.037233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:44.054698 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] HTTP exception thrown: Instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 could not be found. Mar 30 07:16:44.055295 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] Returning 404 to user: Instance b4e395dc-f645-44ef-a69c-b609fcfb7c13 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:16:44.056145 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f030592c-ab11-4a45-874b-0963fd5d984e tempest-DeleteServersTestJSON-2109994494 tempest-DeleteServersTestJSON-2109994494-project] 10.222.0.20 "GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13" status: 404 len: 111 microversion: 2.1 time: 0.040818 Mar 30 07:16:44.056697 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 77/158] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:44 2022] GET /compute/v2.1/servers/b4e395dc-f645-44ef-a69c-b609fcfb7c13 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:16:44.110219 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-36e238e2-75d1-4e03-996f-0bd6293e7f11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:44.111358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-36e238e2-75d1-4e03-996f-0bd6293e7f11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:44.129524 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-36e238e2-75d1-4e03-996f-0bd6293e7f11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:44.130189 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-36e238e2-75d1-4e03-996f-0bd6293e7f11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:44.131165 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-36e238e2-75d1-4e03-996f-0bd6293e7f11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:44.131667 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-36e238e2-75d1-4e03-996f-0bd6293e7f11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:44.348439 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-36e238e2-75d1-4e03-996f-0bd6293e7f11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:44.356419 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-36e238e2-75d1-4e03-996f-0bd6293e7f11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.251058 Mar 30 07:16:44.359864 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 82/159] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:44 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:45.374364 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-941f45fb-816c-454e-ad77-9eea329a4270 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:45.375088 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-941f45fb-816c-454e-ad77-9eea329a4270 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:45.381228 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-941f45fb-816c-454e-ad77-9eea329a4270 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:45.381950 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-941f45fb-816c-454e-ad77-9eea329a4270 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:45.383266 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-941f45fb-816c-454e-ad77-9eea329a4270 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:45.384016 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-941f45fb-816c-454e-ad77-9eea329a4270 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:45.568544 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-941f45fb-816c-454e-ad77-9eea329a4270 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:45.576962 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-941f45fb-816c-454e-ad77-9eea329a4270 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.207272 Mar 30 07:16:45.580043 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 78/160] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:45 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:46.594608 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a3cdbf95-666d-40d8-8e39-7f0ff8f72210 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:46.595229 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a3cdbf95-666d-40d8-8e39-7f0ff8f72210 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:46.602112 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3cdbf95-666d-40d8-8e39-7f0ff8f72210 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:46.602557 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3cdbf95-666d-40d8-8e39-7f0ff8f72210 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:46.603532 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3cdbf95-666d-40d8-8e39-7f0ff8f72210 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:46.604142 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3cdbf95-666d-40d8-8e39-7f0ff8f72210 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:46.821167 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a3cdbf95-666d-40d8-8e39-7f0ff8f72210 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:46.829533 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a3cdbf95-666d-40d8-8e39-7f0ff8f72210 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.238731 Mar 30 07:16:46.830503 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 83/161] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:46 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:47.846689 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0236dcff-4733-4fdc-a9ec-26955fb10d8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:47.847323 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0236dcff-4733-4fdc-a9ec-26955fb10d8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:47.853909 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0236dcff-4733-4fdc-a9ec-26955fb10d8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:47.854360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0236dcff-4733-4fdc-a9ec-26955fb10d8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:47.855125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0236dcff-4733-4fdc-a9ec-26955fb10d8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:47.855552 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0236dcff-4733-4fdc-a9ec-26955fb10d8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:48.005492 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0236dcff-4733-4fdc-a9ec-26955fb10d8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:48.013389 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0236dcff-4733-4fdc-a9ec-26955fb10d8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.170786 Mar 30 07:16:48.013925 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 79/162] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:47 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:49.032986 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-77ea4831-456e-4c3d-8526-3e4b0555cb21 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:49.033644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-77ea4831-456e-4c3d-8526-3e4b0555cb21 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:49.040164 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-77ea4831-456e-4c3d-8526-3e4b0555cb21 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:49.040610 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-77ea4831-456e-4c3d-8526-3e4b0555cb21 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:49.041478 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-77ea4831-456e-4c3d-8526-3e4b0555cb21 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:49.041907 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-77ea4831-456e-4c3d-8526-3e4b0555cb21 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:49.183508 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-77ea4831-456e-4c3d-8526-3e4b0555cb21 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:49.190958 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-77ea4831-456e-4c3d-8526-3e4b0555cb21 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.162520 Mar 30 07:16:49.191530 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 84/163] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:49 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:50.208686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d42f1d9d-2a92-4abd-a4f3-e039c8db9350 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:50.210350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d42f1d9d-2a92-4abd-a4f3-e039c8db9350 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:50.221286 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d42f1d9d-2a92-4abd-a4f3-e039c8db9350 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:50.221907 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d42f1d9d-2a92-4abd-a4f3-e039c8db9350 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:50.222877 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d42f1d9d-2a92-4abd-a4f3-e039c8db9350 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:50.223557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d42f1d9d-2a92-4abd-a4f3-e039c8db9350 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:50.372598 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d42f1d9d-2a92-4abd-a4f3-e039c8db9350 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:50.380153 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d42f1d9d-2a92-4abd-a4f3-e039c8db9350 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.175866 Mar 30 07:16:50.388028 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 80/164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:50 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:51.400710 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fb4e4af0-41a4-444a-87c0-1dd74e93fe2f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:51.402469 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fb4e4af0-41a4-444a-87c0-1dd74e93fe2f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:51.412224 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb4e4af0-41a4-444a-87c0-1dd74e93fe2f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:51.420228 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb4e4af0-41a4-444a-87c0-1dd74e93fe2f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:51.421480 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb4e4af0-41a4-444a-87c0-1dd74e93fe2f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:51.422210 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb4e4af0-41a4-444a-87c0-1dd74e93fe2f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:51.612098 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fb4e4af0-41a4-444a-87c0-1dd74e93fe2f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:51.622757 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fb4e4af0-41a4-444a-87c0-1dd74e93fe2f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.228259 Mar 30 07:16:51.624034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 85/165] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:51 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:52.643537 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-46b67693-fac2-4492-8622-8d4add0b7b2b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:52.644239 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-46b67693-fac2-4492-8622-8d4add0b7b2b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:52.651033 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-46b67693-fac2-4492-8622-8d4add0b7b2b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:52.651678 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-46b67693-fac2-4492-8622-8d4add0b7b2b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:52.652465 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-46b67693-fac2-4492-8622-8d4add0b7b2b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:52.653064 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-46b67693-fac2-4492-8622-8d4add0b7b2b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:52.799633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-46b67693-fac2-4492-8622-8d4add0b7b2b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:52.807486 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-46b67693-fac2-4492-8622-8d4add0b7b2b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.171105 Mar 30 07:16:52.808445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 81/166] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:52 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:53.826156 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-98df6d6e-6566-46da-963a-7cc23301d0ed tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:53.826769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-98df6d6e-6566-46da-963a-7cc23301d0ed tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:53.832958 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-98df6d6e-6566-46da-963a-7cc23301d0ed tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:53.833408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-98df6d6e-6566-46da-963a-7cc23301d0ed tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:53.834235 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-98df6d6e-6566-46da-963a-7cc23301d0ed tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:53.834730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-98df6d6e-6566-46da-963a-7cc23301d0ed tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:54.231436 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-98df6d6e-6566-46da-963a-7cc23301d0ed tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:54.239050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-98df6d6e-6566-46da-963a-7cc23301d0ed tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.417005 Mar 30 07:16:54.239614 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 86/167] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:53 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:55.255852 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-abaaf88c-319b-402d-ad2c-9813f1a1fd68 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:55.257226 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-abaaf88c-319b-402d-ad2c-9813f1a1fd68 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:55.264572 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-abaaf88c-319b-402d-ad2c-9813f1a1fd68 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:55.265266 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-abaaf88c-319b-402d-ad2c-9813f1a1fd68 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:55.266207 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-abaaf88c-319b-402d-ad2c-9813f1a1fd68 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:55.266831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-abaaf88c-319b-402d-ad2c-9813f1a1fd68 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:55.484204 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-abaaf88c-319b-402d-ad2c-9813f1a1fd68 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:55.493624 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-abaaf88c-319b-402d-ad2c-9813f1a1fd68 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.241426 Mar 30 07:16:55.494309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 82/168] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:55 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:56.510517 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ee7bd8e3-0459-4ae6-994d-3692aa754537 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:56.511057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ee7bd8e3-0459-4ae6-994d-3692aa754537 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:56.520573 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ee7bd8e3-0459-4ae6-994d-3692aa754537 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:56.523245 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ee7bd8e3-0459-4ae6-994d-3692aa754537 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:56.526172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ee7bd8e3-0459-4ae6-994d-3692aa754537 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:56.527093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ee7bd8e3-0459-4ae6-994d-3692aa754537 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:56.802307 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ee7bd8e3-0459-4ae6-994d-3692aa754537 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:56.814595 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ee7bd8e3-0459-4ae6-994d-3692aa754537 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.308102 Mar 30 07:16:56.815186 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 87/169] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:56 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:57.834271 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-62864b99-7fbc-4671-aa16-6c198223f8dc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:57.834887 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-62864b99-7fbc-4671-aa16-6c198223f8dc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:57.841676 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-62864b99-7fbc-4671-aa16-6c198223f8dc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:57.842127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-62864b99-7fbc-4671-aa16-6c198223f8dc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:57.842920 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-62864b99-7fbc-4671-aa16-6c198223f8dc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:57.843337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-62864b99-7fbc-4671-aa16-6c198223f8dc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:57.988783 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-62864b99-7fbc-4671-aa16-6c198223f8dc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:57.996825 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-62864b99-7fbc-4671-aa16-6c198223f8dc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.166329 Mar 30 07:16:57.997402 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 83/170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:57 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:16:58.945191 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1640179198", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "networks": [{"uuid": "fc819313-a83f-4db9-a3a8-bf8736f9a577"}]}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:16:58.998508 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] validate_networks() for [('fc819313-a83f-4db9-a3a8-bf8736f9a577', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:16:59.014507 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a5629bee-b167-454d-a089-3b7424498169 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:59.015225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a5629bee-b167-454d-a089-3b7424498169 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:59.021639 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5629bee-b167-454d-a089-3b7424498169 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:59.022018 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5629bee-b167-454d-a089-3b7424498169 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:59.023101 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5629bee-b167-454d-a089-3b7424498169 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:59.023573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5629bee-b167-454d-a089-3b7424498169 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:59.230312 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a5629bee-b167-454d-a089-3b7424498169 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:59.238473 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a5629bee-b167-454d-a089-3b7424498169 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.228131 Mar 30 07:16:59.247916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 84/171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:59 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:16:59.439768 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:16:59.440646 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:16:59.441368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:16:59.441845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:16:59.442325 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:16:59.452083 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:59.452613 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:59.453505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:16:59.454076 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:16:59.471388 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Getting quotas for project fdbabd5e38b749abb59cbf2680697a54. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:16:59.475262 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Getting quotas for user b25ac073374a491899b09b5c7810eb84 and project fdbabd5e38b749abb59cbf2680697a54. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:16:59.486691 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:16:59.489029 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:16:59.533050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1854e1bb-bd59-46b1-b9a2-40d492af9bc8 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591620 Mar 30 07:16:59.533885 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 88/172] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:16:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:16:59.544469 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ee90cfa5-7707-446b-9219-9d289be9a408 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:16:59.545265 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ee90cfa5-7707-446b-9219-9d289be9a408 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:16:59.603656 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ee90cfa5-7707-446b-9219-9d289be9a408 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:16:59.611705 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ee90cfa5-7707-446b-9219-9d289be9a408 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1219 microversion: 2.1 time: 0.071140 Mar 30 07:16:59.614653 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 85/173] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:16:59 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:00.254724 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-19a2ae6f-fe3e-4bad-b22d-46be6db54643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:00.255332 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-19a2ae6f-fe3e-4bad-b22d-46be6db54643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:00.261548 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-19a2ae6f-fe3e-4bad-b22d-46be6db54643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:00.261989 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-19a2ae6f-fe3e-4bad-b22d-46be6db54643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:00.262746 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-19a2ae6f-fe3e-4bad-b22d-46be6db54643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:00.263169 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-19a2ae6f-fe3e-4bad-b22d-46be6db54643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:00.398388 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-19a2ae6f-fe3e-4bad-b22d-46be6db54643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:00.406168 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-19a2ae6f-fe3e-4bad-b22d-46be6db54643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.155310 Mar 30 07:17:00.406725 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:00 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:00.633441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f7687638-8d1e-4c16-8656-17d470f2c742 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:00.634387 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f7687638-8d1e-4c16-8656-17d470f2c742 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:00.641470 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f7687638-8d1e-4c16-8656-17d470f2c742 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:00.641924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f7687638-8d1e-4c16-8656-17d470f2c742 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:00.642692 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f7687638-8d1e-4c16-8656-17d470f2c742 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:00.643160 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f7687638-8d1e-4c16-8656-17d470f2c742 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:00.706611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f7687638-8d1e-4c16-8656-17d470f2c742 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:00.714411 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f7687638-8d1e-4c16-8656-17d470f2c742 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1223 microversion: 2.1 time: 0.087692 Mar 30 07:17:00.714980 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 86/175] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:00 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:01.422506 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4bc9b95d-6c32-46e9-91c3-f5af5942c173 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:01.423117 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4bc9b95d-6c32-46e9-91c3-f5af5942c173 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:01.429496 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4bc9b95d-6c32-46e9-91c3-f5af5942c173 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:01.429942 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4bc9b95d-6c32-46e9-91c3-f5af5942c173 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:01.430708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4bc9b95d-6c32-46e9-91c3-f5af5942c173 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:01.431138 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4bc9b95d-6c32-46e9-91c3-f5af5942c173 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:01.576594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4bc9b95d-6c32-46e9-91c3-f5af5942c173 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:01.583969 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4bc9b95d-6c32-46e9-91c3-f5af5942c173 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.165235 Mar 30 07:17:01.584516 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 90/176] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:01 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:01.731835 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1cc448a3-5720-40bb-9341-3edd1855557a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:01.732490 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1cc448a3-5720-40bb-9341-3edd1855557a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:01.739801 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1cc448a3-5720-40bb-9341-3edd1855557a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:01.740283 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1cc448a3-5720-40bb-9341-3edd1855557a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:01.741138 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1cc448a3-5720-40bb-9341-3edd1855557a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:01.742148 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1cc448a3-5720-40bb-9341-3edd1855557a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:01.804288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1cc448a3-5720-40bb-9341-3edd1855557a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:01.811569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1cc448a3-5720-40bb-9341-3edd1855557a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1223 microversion: 2.1 time: 0.084825 Mar 30 07:17:01.812162 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 87/177] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:01 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:02.601586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d7b6bdf5-54cf-4d86-87a1-d9612920edd0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:02.602339 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d7b6bdf5-54cf-4d86-87a1-d9612920edd0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:02.609316 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d7b6bdf5-54cf-4d86-87a1-d9612920edd0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:02.610006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d7b6bdf5-54cf-4d86-87a1-d9612920edd0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:02.610913 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d7b6bdf5-54cf-4d86-87a1-d9612920edd0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:02.611496 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d7b6bdf5-54cf-4d86-87a1-d9612920edd0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:02.770545 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d7b6bdf5-54cf-4d86-87a1-d9612920edd0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:02.778736 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d7b6bdf5-54cf-4d86-87a1-d9612920edd0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.181982 Mar 30 07:17:02.780044 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 91/178] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:02 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:02.836690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c845ead6-3742-42eb-8598-39ce1ce0bdf1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:02.837390 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c845ead6-3742-42eb-8598-39ce1ce0bdf1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:02.844283 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c845ead6-3742-42eb-8598-39ce1ce0bdf1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:02.844808 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c845ead6-3742-42eb-8598-39ce1ce0bdf1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:02.845599 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c845ead6-3742-42eb-8598-39ce1ce0bdf1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:02.846055 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c845ead6-3742-42eb-8598-39ce1ce0bdf1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:02.912845 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c845ead6-3742-42eb-8598-39ce1ce0bdf1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:02.920193 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c845ead6-3742-42eb-8598-39ce1ce0bdf1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1277 microversion: 2.1 time: 0.088925 Mar 30 07:17:02.920767 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 88/179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:02 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:03.797458 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-36ac3073-a44a-4feb-a6d6-5668fcc60868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:03.805073 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-4e8b6811-4ebc-4443-b2d9-9dda810d93fa req-1a7cdf92-0741-4c1b-805a-67d4ea9abb67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f5b104-2044-42c1-9fc9-af2d203240cf", "tag": "86f18ddd-619f-410a-aacd-20886004ab33"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:03.807341 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-36ac3073-a44a-4feb-a6d6-5668fcc60868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:03.825695 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-36ac3073-a44a-4feb-a6d6-5668fcc60868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:03.826143 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-36ac3073-a44a-4feb-a6d6-5668fcc60868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:03.826995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-36ac3073-a44a-4feb-a6d6-5668fcc60868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:03.827507 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-36ac3073-a44a-4feb-a6d6-5668fcc60868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:03.827839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-4e8b6811-4ebc-4443-b2d9-9dda810d93fa req-1a7cdf92-0741-4c1b-805a-67d4ea9abb67 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:03.828687 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-4e8b6811-4ebc-4443-b2d9-9dda810d93fa req-1a7cdf92-0741-4c1b-805a-67d4ea9abb67 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:03.864564 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-4e8b6811-4ebc-4443-b2d9-9dda810d93fa req-1a7cdf92-0741-4c1b-805a-67d4ea9abb67 service nova] Creating event network-changed:86f18ddd-619f-410a-aacd-20886004ab33 for instance 13f5b104-2044-42c1-9fc9-af2d203240cf on hv-cinder-83577 Mar 30 07:17:03.877747 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-4e8b6811-4ebc-4443-b2d9-9dda810d93fa req-1a7cdf92-0741-4c1b-805a-67d4ea9abb67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077873 Mar 30 07:17:03.879442 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 89/180] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:03.938454 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9f18797f-9b7b-4061-9f8a-a385047e9444 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:03.939412 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9f18797f-9b7b-4061-9f8a-a385047e9444 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:03.950481 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f18797f-9b7b-4061-9f8a-a385047e9444 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:03.951229 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f18797f-9b7b-4061-9f8a-a385047e9444 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:03.952258 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f18797f-9b7b-4061-9f8a-a385047e9444 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:03.953068 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f18797f-9b7b-4061-9f8a-a385047e9444 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:04.185223 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-36ac3073-a44a-4feb-a6d6-5668fcc60868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:04.204632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-36ac3073-a44a-4feb-a6d6-5668fcc60868 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.410648 Mar 30 07:17:04.205971 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 92/181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:03 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:04.243005 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9f18797f-9b7b-4061-9f8a-a385047e9444 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:04.261782 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9f18797f-9b7b-4061-9f8a-a385047e9444 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1319 microversion: 2.1 time: 0.327391 Mar 30 07:17:04.262644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 90/182] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:03 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:05.221424 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e6d04fb1-bc47-4bbc-baf0-fb563854377b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:05.221896 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e6d04fb1-bc47-4bbc-baf0-fb563854377b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:05.228853 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e6d04fb1-bc47-4bbc-baf0-fb563854377b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:05.228853 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e6d04fb1-bc47-4bbc-baf0-fb563854377b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:05.229567 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e6d04fb1-bc47-4bbc-baf0-fb563854377b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:05.230012 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e6d04fb1-bc47-4bbc-baf0-fb563854377b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:05.280285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c2a7de85-6ba4-4312-a378-9a3e622e9a33 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:05.281516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c2a7de85-6ba4-4312-a378-9a3e622e9a33 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:05.302693 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c2a7de85-6ba4-4312-a378-9a3e622e9a33 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:05.303173 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c2a7de85-6ba4-4312-a378-9a3e622e9a33 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:05.304146 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c2a7de85-6ba4-4312-a378-9a3e622e9a33 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:05.304765 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c2a7de85-6ba4-4312-a378-9a3e622e9a33 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:05.462334 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e6d04fb1-bc47-4bbc-baf0-fb563854377b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:05.473221 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e6d04fb1-bc47-4bbc-baf0-fb563854377b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.254588 Mar 30 07:17:05.476375 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 93/183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:05 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:05.518551 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c2a7de85-6ba4-4312-a378-9a3e622e9a33 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:05.534018 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c2a7de85-6ba4-4312-a378-9a3e622e9a33 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1319 microversion: 2.1 time: 0.257942 Mar 30 07:17:05.544179 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 91/184] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:05 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:06.491365 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-32bca6d8-b2a0-4644-a120-89e0f3b35620 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:06.492889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-32bca6d8-b2a0-4644-a120-89e0f3b35620 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:06.499545 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-32bca6d8-b2a0-4644-a120-89e0f3b35620 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:06.500321 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-32bca6d8-b2a0-4644-a120-89e0f3b35620 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:06.501279 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-32bca6d8-b2a0-4644-a120-89e0f3b35620 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:06.502358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-32bca6d8-b2a0-4644-a120-89e0f3b35620 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:06.552233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8efca6a4-2c4e-46d1-93de-c5b58441ea46 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:06.555083 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-8efca6a4-2c4e-46d1-93de-c5b58441ea46 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:06.565741 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8efca6a4-2c4e-46d1-93de-c5b58441ea46 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:06.566661 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8efca6a4-2c4e-46d1-93de-c5b58441ea46 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:06.568970 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8efca6a4-2c4e-46d1-93de-c5b58441ea46 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:06.570145 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8efca6a4-2c4e-46d1-93de-c5b58441ea46 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:06.709272 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-32bca6d8-b2a0-4644-a120-89e0f3b35620 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:06.721730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-32bca6d8-b2a0-4644-a120-89e0f3b35620 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.235652 Mar 30 07:17:06.736323 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 94/185] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:06 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:06.791789 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-8efca6a4-2c4e-46d1-93de-c5b58441ea46 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:06.802715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-8efca6a4-2c4e-46d1-93de-c5b58441ea46 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1319 microversion: 2.1 time: 0.255519 Mar 30 07:17:06.803285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 92/186] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:06 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:07.739527 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a9b9f2d9-ec6d-430b-9fec-b4cc0de37895 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:07.740985 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a9b9f2d9-ec6d-430b-9fec-b4cc0de37895 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:07.751862 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a9b9f2d9-ec6d-430b-9fec-b4cc0de37895 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:07.752840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a9b9f2d9-ec6d-430b-9fec-b4cc0de37895 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:07.756688 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a9b9f2d9-ec6d-430b-9fec-b4cc0de37895 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:07.757392 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a9b9f2d9-ec6d-430b-9fec-b4cc0de37895 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:07.824851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9a2e9626-a805-4e94-92d8-16360f8d7e42 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:07.826220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9a2e9626-a805-4e94-92d8-16360f8d7e42 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:07.837132 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9a2e9626-a805-4e94-92d8-16360f8d7e42 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:07.842078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9a2e9626-a805-4e94-92d8-16360f8d7e42 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:07.843243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9a2e9626-a805-4e94-92d8-16360f8d7e42 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:07.843452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9a2e9626-a805-4e94-92d8-16360f8d7e42 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:08.049695 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a9b9f2d9-ec6d-430b-9fec-b4cc0de37895 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:08.058881 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a9b9f2d9-ec6d-430b-9fec-b4cc0de37895 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.324129 Mar 30 07:17:08.059795 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 95/187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:07 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:08.078579 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9a2e9626-a805-4e94-92d8-16360f8d7e42 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:08.090503 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9a2e9626-a805-4e94-92d8-16360f8d7e42 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1319 microversion: 2.1 time: 0.269614 Mar 30 07:17:08.091609 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 93/188] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:07 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:09.083218 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-eb118d44-7817-4a4a-a520-1f3543ed6abb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:09.084577 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-eb118d44-7817-4a4a-a520-1f3543ed6abb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:09.101855 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eb118d44-7817-4a4a-a520-1f3543ed6abb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:09.102331 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eb118d44-7817-4a4a-a520-1f3543ed6abb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:09.103142 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eb118d44-7817-4a4a-a520-1f3543ed6abb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:09.103576 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eb118d44-7817-4a4a-a520-1f3543ed6abb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:09.108056 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-59daad11-9f1e-4b9b-b5b5-ec03b3e875d1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:09.109346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-59daad11-9f1e-4b9b-b5b5-ec03b3e875d1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:09.119048 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-59daad11-9f1e-4b9b-b5b5-ec03b3e875d1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:09.119711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-59daad11-9f1e-4b9b-b5b5-ec03b3e875d1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:09.121140 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-59daad11-9f1e-4b9b-b5b5-ec03b3e875d1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:09.123163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-59daad11-9f1e-4b9b-b5b5-ec03b3e875d1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:09.376983 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-59daad11-9f1e-4b9b-b5b5-ec03b3e875d1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:09.378912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-eb118d44-7817-4a4a-a520-1f3543ed6abb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:09.386009 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-59daad11-9f1e-4b9b-b5b5-ec03b3e875d1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1319 microversion: 2.1 time: 0.282438 Mar 30 07:17:09.387408 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 94/189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:09 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:09.392445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-9d7dfda6-61cc-448f-be87-d76b467f161f req-34477f7f-6825-446a-8d19-27ae760013ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f5b104-2044-42c1-9fc9-af2d203240cf", "name": "network-vif-plugged", "status": "completed", "tag": "86f18ddd-619f-410a-aacd-20886004ab33"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:09.396176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-eb118d44-7817-4a4a-a520-1f3543ed6abb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.314678 Mar 30 07:17:09.401698 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-9d7dfda6-61cc-448f-be87-d76b467f161f req-34477f7f-6825-446a-8d19-27ae760013ef service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:09.402397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-9d7dfda6-61cc-448f-be87-d76b467f161f req-34477f7f-6825-446a-8d19-27ae760013ef service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:09.404679 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 96/190] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:09 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:09.415778 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-9d7dfda6-61cc-448f-be87-d76b467f161f req-34477f7f-6825-446a-8d19-27ae760013ef service nova] Creating event network-vif-plugged:86f18ddd-619f-410a-aacd-20886004ab33 for instance 13f5b104-2044-42c1-9fc9-af2d203240cf on hv-cinder-83577 Mar 30 07:17:09.421335 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-9d7dfda6-61cc-448f-be87-d76b467f161f req-34477f7f-6825-446a-8d19-27ae760013ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032187 Mar 30 07:17:09.422002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 95/191] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:10.403331 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3dd2e806-db24-4624-82f3-624d50ddb6bf tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:10.403999 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3dd2e806-db24-4624-82f3-624d50ddb6bf tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:10.412415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3dd2e806-db24-4624-82f3-624d50ddb6bf tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:10.412984 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3dd2e806-db24-4624-82f3-624d50ddb6bf tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:10.414243 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3dd2e806-db24-4624-82f3-624d50ddb6bf tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:10.414675 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3dd2e806-db24-4624-82f3-624d50ddb6bf tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:10.415627 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-78a056eb-e64a-4aa1-bcbd-9c344b4d915d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:10.416972 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-78a056eb-e64a-4aa1-bcbd-9c344b4d915d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:10.423404 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-78a056eb-e64a-4aa1-bcbd-9c344b4d915d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:10.425982 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-78a056eb-e64a-4aa1-bcbd-9c344b4d915d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:10.426839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-78a056eb-e64a-4aa1-bcbd-9c344b4d915d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:10.432527 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-78a056eb-e64a-4aa1-bcbd-9c344b4d915d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:10.636462 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-78a056eb-e64a-4aa1-bcbd-9c344b4d915d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:10.641474 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3dd2e806-db24-4624-82f3-624d50ddb6bf tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:10.644570 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-78a056eb-e64a-4aa1-bcbd-9c344b4d915d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.234198 Mar 30 07:17:10.645268 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 96/192] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:10 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:10.650538 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3dd2e806-db24-4624-82f3-624d50ddb6bf tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1319 microversion: 2.1 time: 0.251004 Mar 30 07:17:10.651113 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 97/193] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:10 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:11.664958 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2086298895", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "networks": [{"uuid": "6c352acd-aebe-4eb6-a0e7-b315ecb9a217"}]}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:11.665733 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-25f19382-44a3-41b7-9209-822feb017d47 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:11.666391 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-25f19382-44a3-41b7-9209-822feb017d47 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:11.672470 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-25f19382-44a3-41b7-9209-822feb017d47 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:11.672914 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-25f19382-44a3-41b7-9209-822feb017d47 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:11.673694 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-25f19382-44a3-41b7-9209-822feb017d47 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:11.674204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-25f19382-44a3-41b7-9209-822feb017d47 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:11.718445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] validate_networks() for [('6c352acd-aebe-4eb6-a0e7-b315ecb9a217', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:17:11.899261 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-25f19382-44a3-41b7-9209-822feb017d47 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:11.907727 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-25f19382-44a3-41b7-9209-822feb017d47 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.246200 Mar 30 07:17:11.908462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 98/194] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:11 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:11.913495 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f1066414-44d0-4034-8cd5-1fa3c7af337d tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:11.914554 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f1066414-44d0-4034-8cd5-1fa3c7af337d tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:11.920639 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f1066414-44d0-4034-8cd5-1fa3c7af337d tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:11.921190 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f1066414-44d0-4034-8cd5-1fa3c7af337d tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:11.922547 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f1066414-44d0-4034-8cd5-1fa3c7af337d tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:11.922547 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f1066414-44d0-4034-8cd5-1fa3c7af337d tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:12.175591 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f1066414-44d0-4034-8cd5-1fa3c7af337d tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:12.184503 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f1066414-44d0-4034-8cd5-1fa3c7af337d tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1508 microversion: 2.1 time: 0.274830 Mar 30 07:17:12.191779 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 99/195] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:11 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:12.201465 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:17:12.201885 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:17:12.202354 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:17:12.202756 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:17:12.203374 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:17:12.212843 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:12.213565 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:12.214706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:12.215136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:12.232296 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Getting quotas for project c7ad5fa9994340d78e5489bc40885480. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:17:12.236228 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Getting quotas for user 23be35231cd6493e917259e81b849c8d and project c7ad5fa9994340d78e5489bc40885480. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:17:12.247436 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:17:12.249758 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:17:12.301791 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b630c89c-1b3d-4479-ae30-79acc647d629 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641065 Mar 30 07:17:12.302587 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 97/196] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:17:12.313230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b8f31d44-e822-4926-bda6-21ac2911765b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:12.313830 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b8f31d44-e822-4926-bda6-21ac2911765b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:12.377127 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b8f31d44-e822-4926-bda6-21ac2911765b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:12.384370 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b8f31d44-e822-4926-bda6-21ac2911765b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1214 microversion: 2.1 time: 0.075230 Mar 30 07:17:12.394224 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 100/197] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:12 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:12.928967 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-897ec77d-6452-4677-8707-2d315fd0348c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:12.929863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-897ec77d-6452-4677-8707-2d315fd0348c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:12.937837 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-897ec77d-6452-4677-8707-2d315fd0348c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:12.938300 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-897ec77d-6452-4677-8707-2d315fd0348c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:12.939092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-897ec77d-6452-4677-8707-2d315fd0348c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:12.939541 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-897ec77d-6452-4677-8707-2d315fd0348c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:13.088841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-897ec77d-6452-4677-8707-2d315fd0348c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:13.096432 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-897ec77d-6452-4677-8707-2d315fd0348c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.174882 Mar 30 07:17:13.096991 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 98/198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:12 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:13.405753 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fb8507e5-90f5-4f58-812b-5750d47d3e37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:13.406763 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fb8507e5-90f5-4f58-812b-5750d47d3e37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:13.416299 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb8507e5-90f5-4f58-812b-5750d47d3e37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:13.416742 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb8507e5-90f5-4f58-812b-5750d47d3e37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:13.417504 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb8507e5-90f5-4f58-812b-5750d47d3e37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:13.417932 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb8507e5-90f5-4f58-812b-5750d47d3e37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:13.488124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fb8507e5-90f5-4f58-812b-5750d47d3e37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:13.496527 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fb8507e5-90f5-4f58-812b-5750d47d3e37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1218 microversion: 2.1 time: 0.097272 Mar 30 07:17:13.497096 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 101/199] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:13 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:14.113880 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a1f4f343-6ce3-4adc-81c3-e59fad82abf9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:14.114525 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a1f4f343-6ce3-4adc-81c3-e59fad82abf9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:14.121222 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a1f4f343-6ce3-4adc-81c3-e59fad82abf9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:14.121680 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a1f4f343-6ce3-4adc-81c3-e59fad82abf9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:14.122443 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a1f4f343-6ce3-4adc-81c3-e59fad82abf9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:14.122878 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a1f4f343-6ce3-4adc-81c3-e59fad82abf9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:14.277882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a1f4f343-6ce3-4adc-81c3-e59fad82abf9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:14.285542 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a1f4f343-6ce3-4adc-81c3-e59fad82abf9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.175634 Mar 30 07:17:14.286154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 99/200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:14 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:14.517354 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-027fb292-fa5c-45c1-ae12-cfd4dba2279f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:14.518209 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-027fb292-fa5c-45c1-ae12-cfd4dba2279f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:14.527004 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-027fb292-fa5c-45c1-ae12-cfd4dba2279f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:14.527450 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-027fb292-fa5c-45c1-ae12-cfd4dba2279f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:14.528258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-027fb292-fa5c-45c1-ae12-cfd4dba2279f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:14.528685 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-027fb292-fa5c-45c1-ae12-cfd4dba2279f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:14.586815 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-027fb292-fa5c-45c1-ae12-cfd4dba2279f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:14.594492 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-027fb292-fa5c-45c1-ae12-cfd4dba2279f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1218 microversion: 2.1 time: 0.083724 Mar 30 07:17:14.595068 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 102/201] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:14 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:15.302876 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ee2884d7-d661-4b32-ad05-ae950ef76c99 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:15.303481 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ee2884d7-d661-4b32-ad05-ae950ef76c99 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:15.310782 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ee2884d7-d661-4b32-ad05-ae950ef76c99 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:15.311084 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ee2884d7-d661-4b32-ad05-ae950ef76c99 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:15.311858 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ee2884d7-d661-4b32-ad05-ae950ef76c99 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:15.312522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ee2884d7-d661-4b32-ad05-ae950ef76c99 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:15.460167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ee2884d7-d661-4b32-ad05-ae950ef76c99 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:15.469553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ee2884d7-d661-4b32-ad05-ae950ef76c99 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.170357 Mar 30 07:17:15.481307 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 100/202] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:15 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:15.611729 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-55ecbd16-7908-4c37-993c-1b4a9ad15d28 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:15.612359 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-55ecbd16-7908-4c37-993c-1b4a9ad15d28 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:15.618273 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-55ecbd16-7908-4c37-993c-1b4a9ad15d28 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:15.618723 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-55ecbd16-7908-4c37-993c-1b4a9ad15d28 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:15.619570 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-55ecbd16-7908-4c37-993c-1b4a9ad15d28 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:15.620239 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-55ecbd16-7908-4c37-993c-1b4a9ad15d28 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:15.687371 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-55ecbd16-7908-4c37-993c-1b4a9ad15d28 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:15.697847 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-55ecbd16-7908-4c37-993c-1b4a9ad15d28 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1274 microversion: 2.1 time: 0.090030 Mar 30 07:17:15.698605 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 103/203] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:15 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:16.490916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a24f3875-9ab4-4788-ae49-54b5f176abc6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:16.492471 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a24f3875-9ab4-4788-ae49-54b5f176abc6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:16.499384 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a24f3875-9ab4-4788-ae49-54b5f176abc6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:16.499952 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a24f3875-9ab4-4788-ae49-54b5f176abc6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:16.500800 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a24f3875-9ab4-4788-ae49-54b5f176abc6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:16.501301 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a24f3875-9ab4-4788-ae49-54b5f176abc6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:16.668835 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a24f3875-9ab4-4788-ae49-54b5f176abc6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:16.687961 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a24f3875-9ab4-4788-ae49-54b5f176abc6 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1521 microversion: 2.1 time: 0.202957 Mar 30 07:17:16.691854 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 101/204] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:16 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:16.715303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-560c11f1-bd5e-42dd-9275-44ab01df3450 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:16.715997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-560c11f1-bd5e-42dd-9275-44ab01df3450 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:16.725865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-560c11f1-bd5e-42dd-9275-44ab01df3450 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:16.726373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-560c11f1-bd5e-42dd-9275-44ab01df3450 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:16.727522 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-560c11f1-bd5e-42dd-9275-44ab01df3450 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:16.728012 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-560c11f1-bd5e-42dd-9275-44ab01df3450 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:16.882906 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-560c11f1-bd5e-42dd-9275-44ab01df3450 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:16.891151 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-560c11f1-bd5e-42dd-9275-44ab01df3450 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1314 microversion: 2.1 time: 0.180395 Mar 30 07:17:16.891733 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 104/205] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:16 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:17.143586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-8a95d1bc-8357-4c89-a92c-86472fbdbc71 req-475f34c0-201f-40fc-8236-ee06c7d1d172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26bca037-dbff-4f88-9ce6-c46c98ff6c6f", "tag": "a7708761-35fd-489d-95c3-07dfd0a6964a"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:17.163142 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-8a95d1bc-8357-4c89-a92c-86472fbdbc71 req-475f34c0-201f-40fc-8236-ee06c7d1d172 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:17.163595 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-8a95d1bc-8357-4c89-a92c-86472fbdbc71 req-475f34c0-201f-40fc-8236-ee06c7d1d172 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:17.175916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-8a95d1bc-8357-4c89-a92c-86472fbdbc71 req-475f34c0-201f-40fc-8236-ee06c7d1d172 service nova] Creating event network-changed:a7708761-35fd-489d-95c3-07dfd0a6964a for instance 26bca037-dbff-4f88-9ce6-c46c98ff6c6f on hv-cinder-83577 Mar 30 07:17:17.180856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-8a95d1bc-8357-4c89-a92c-86472fbdbc71 req-475f34c0-201f-40fc-8236-ee06c7d1d172 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052365 Mar 30 07:17:17.181642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 102/206] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:17.707667 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2cfa4542-e870-4eb9-84be-911dc028c633 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:17.708316 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2cfa4542-e870-4eb9-84be-911dc028c633 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:17.715158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2cfa4542-e870-4eb9-84be-911dc028c633 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:17.715607 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2cfa4542-e870-4eb9-84be-911dc028c633 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:17.716428 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2cfa4542-e870-4eb9-84be-911dc028c633 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:17.716865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2cfa4542-e870-4eb9-84be-911dc028c633 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:17.868383 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2cfa4542-e870-4eb9-84be-911dc028c633 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:17.878406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2cfa4542-e870-4eb9-84be-911dc028c633 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1501 microversion: 2.1 time: 0.176009 Mar 30 07:17:17.881897 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 105/207] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:17 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:17.898706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c540b653-171a-44c6-84f8-440c7d386cd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:17.899490 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c540b653-171a-44c6-84f8-440c7d386cd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:17.907538 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c540b653-171a-44c6-84f8-440c7d386cd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:17.908149 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c540b653-171a-44c6-84f8-440c7d386cd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:17.909032 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c540b653-171a-44c6-84f8-440c7d386cd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:17.909553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c540b653-171a-44c6-84f8-440c7d386cd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:17.910943 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-05b745c0-a2b2-4f87-9522-5a431f93b2fe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:17.911552 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-05b745c0-a2b2-4f87-9522-5a431f93b2fe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:17.917811 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-05b745c0-a2b2-4f87-9522-5a431f93b2fe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:17.918258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-05b745c0-a2b2-4f87-9522-5a431f93b2fe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:17.919033 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-05b745c0-a2b2-4f87-9522-5a431f93b2fe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:17.919643 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-05b745c0-a2b2-4f87-9522-5a431f93b2fe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:18.130298 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c540b653-171a-44c6-84f8-440c7d386cd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:18.134356 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-05b745c0-a2b2-4f87-9522-5a431f93b2fe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:18.138265 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c540b653-171a-44c6-84f8-440c7d386cd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1517 microversion: 2.1 time: 0.244548 Mar 30 07:17:18.142308 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-05b745c0-a2b2-4f87-9522-5a431f93b2fe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1314 microversion: 2.1 time: 0.235721 Mar 30 07:17:18.143854 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 106/208] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:17 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:18.150992 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 103/209] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:17 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:19.159780 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2082c930-985a-482a-b5d9-f09af7b971b1 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:19.160415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2082c930-985a-482a-b5d9-f09af7b971b1 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:19.166408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2082c930-985a-482a-b5d9-f09af7b971b1 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:19.166982 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2082c930-985a-482a-b5d9-f09af7b971b1 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:19.167749 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2082c930-985a-482a-b5d9-f09af7b971b1 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:19.168204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2082c930-985a-482a-b5d9-f09af7b971b1 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:19.316233 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2082c930-985a-482a-b5d9-f09af7b971b1 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:19.324259 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2082c930-985a-482a-b5d9-f09af7b971b1 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1314 microversion: 2.1 time: 0.168270 Mar 30 07:17:19.333252 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 107/210] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:19 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:19.550835 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8af47c42-7e15-4acb-8c04-becb143e10a2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:19.551841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-8af47c42-7e15-4acb-8c04-becb143e10a2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:19.558913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8af47c42-7e15-4acb-8c04-becb143e10a2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:19.559355 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8af47c42-7e15-4acb-8c04-becb143e10a2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:19.560184 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8af47c42-7e15-4acb-8c04-becb143e10a2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:19.560610 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8af47c42-7e15-4acb-8c04-becb143e10a2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:19.583641 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-8af47c42-7e15-4acb-8c04-becb143e10a2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lazy-loading 'flavor' on Instance uuid 7fedaffa-1632-4376-a01c-64b81265770e {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:17:19.714254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-8af47c42-7e15-4acb-8c04-becb143e10a2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e/action" status: 200 len: 32 microversion: 2.1 time: 0.168271 Mar 30 07:17:19.714970 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 104/211] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:17:19 2022] POST /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:17:19.723975 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3e6accbc-f195-4bd7-bbb3-7e96be455525 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:19.724582 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3e6accbc-f195-4bd7-bbb3-7e96be455525 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:19.731310 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3e6accbc-f195-4bd7-bbb3-7e96be455525 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:19.731916 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3e6accbc-f195-4bd7-bbb3-7e96be455525 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:19.733076 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3e6accbc-f195-4bd7-bbb3-7e96be455525 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:19.733625 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3e6accbc-f195-4bd7-bbb3-7e96be455525 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:19.883687 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3e6accbc-f195-4bd7-bbb3-7e96be455525 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:19.891457 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3e6accbc-f195-4bd7-bbb3-7e96be455525 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.171306 Mar 30 07:17:19.892307 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 108/212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:19 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:20.342106 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-75904679-2eae-4ee5-a54f-8795f2e09327 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:20.342784 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-75904679-2eae-4ee5-a54f-8795f2e09327 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:20.349320 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75904679-2eae-4ee5-a54f-8795f2e09327 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:20.349766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75904679-2eae-4ee5-a54f-8795f2e09327 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:20.350528 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75904679-2eae-4ee5-a54f-8795f2e09327 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:20.351005 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75904679-2eae-4ee5-a54f-8795f2e09327 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:20.497333 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-75904679-2eae-4ee5-a54f-8795f2e09327 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:20.505219 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-75904679-2eae-4ee5-a54f-8795f2e09327 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1314 microversion: 2.1 time: 0.168078 Mar 30 07:17:20.505853 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:20 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:20.908757 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ec6b6211-274c-47df-b954-cb99e7caeef7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:20.909330 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ec6b6211-274c-47df-b954-cb99e7caeef7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:20.915607 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ec6b6211-274c-47df-b954-cb99e7caeef7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:20.916154 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ec6b6211-274c-47df-b954-cb99e7caeef7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:20.916917 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ec6b6211-274c-47df-b954-cb99e7caeef7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:20.917434 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ec6b6211-274c-47df-b954-cb99e7caeef7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:21.068517 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ec6b6211-274c-47df-b954-cb99e7caeef7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:21.082686 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ec6b6211-274c-47df-b954-cb99e7caeef7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.177613 Mar 30 07:17:21.083364 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 109/214] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:20 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:21.522285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e29dde64-f5fa-47d3-ada6-3baf83b0c75f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:21.523001 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e29dde64-f5fa-47d3-ada6-3baf83b0c75f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:21.529860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e29dde64-f5fa-47d3-ada6-3baf83b0c75f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:21.530428 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e29dde64-f5fa-47d3-ada6-3baf83b0c75f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:21.531286 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e29dde64-f5fa-47d3-ada6-3baf83b0c75f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:21.531774 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e29dde64-f5fa-47d3-ada6-3baf83b0c75f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:21.675452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e29dde64-f5fa-47d3-ada6-3baf83b0c75f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:21.683346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e29dde64-f5fa-47d3-ada6-3baf83b0c75f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1314 microversion: 2.1 time: 0.165367 Mar 30 07:17:21.684500 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:21 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:22.101490 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ce0bb1f2-b0d3-4aae-bca4-ad64257d9394 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:22.102912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ce0bb1f2-b0d3-4aae-bca4-ad64257d9394 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:22.112706 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce0bb1f2-b0d3-4aae-bca4-ad64257d9394 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:22.113511 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce0bb1f2-b0d3-4aae-bca4-ad64257d9394 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:22.114685 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce0bb1f2-b0d3-4aae-bca4-ad64257d9394 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:22.115650 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce0bb1f2-b0d3-4aae-bca4-ad64257d9394 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:22.256029 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ce0bb1f2-b0d3-4aae-bca4-ad64257d9394 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:22.264255 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ce0bb1f2-b0d3-4aae-bca4-ad64257d9394 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.167749 Mar 30 07:17:22.264945 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 110/216] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:22 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:22.700204 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-aa2aeba0-05c4-480a-ba62-6ef9defc7dbd tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:22.700730 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-aa2aeba0-05c4-480a-ba62-6ef9defc7dbd tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:22.707444 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-aa2aeba0-05c4-480a-ba62-6ef9defc7dbd tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:22.708037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-aa2aeba0-05c4-480a-ba62-6ef9defc7dbd tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:22.708806 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-aa2aeba0-05c4-480a-ba62-6ef9defc7dbd tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:22.709238 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-aa2aeba0-05c4-480a-ba62-6ef9defc7dbd tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:22.790892 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-82cf9ba0-9342-41b0-98e7-a2cd9d69ab42 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:22.791387 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-82cf9ba0-9342-41b0-98e7-a2cd9d69ab42 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:22.800199 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-82cf9ba0-9342-41b0-98e7-a2cd9d69ab42 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:22.800960 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-82cf9ba0-9342-41b0-98e7-a2cd9d69ab42 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:22.801733 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-82cf9ba0-9342-41b0-98e7-a2cd9d69ab42 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:22.802137 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-82cf9ba0-9342-41b0-98e7-a2cd9d69ab42 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:22.825979 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-82cf9ba0-9342-41b0-98e7-a2cd9d69ab42 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/ips" status: 200 len: 147 microversion: 2.1 time: 0.039334 Mar 30 07:17:22.826759 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 111/217] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:17:22 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:22.852069 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-aa2aeba0-05c4-480a-ba62-6ef9defc7dbd tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:22.860010 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-aa2aeba0-05c4-480a-ba62-6ef9defc7dbd tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1314 microversion: 2.1 time: 0.163911 Mar 30 07:17:22.860594 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 107/218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:22 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:23.287654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a70ccc56-04fc-42e2-98a6-3df2c6076380 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:23.288881 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a70ccc56-04fc-42e2-98a6-3df2c6076380 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:23.299942 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a70ccc56-04fc-42e2-98a6-3df2c6076380 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:23.303924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a70ccc56-04fc-42e2-98a6-3df2c6076380 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:23.304818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a70ccc56-04fc-42e2-98a6-3df2c6076380 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:23.305334 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a70ccc56-04fc-42e2-98a6-3df2c6076380 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:23.337701 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-fc963f61-bd14-4525-8113-8886fb7a8bd3 req-d1e53ea4-a377-41fb-b734-491853d9f8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bca037-dbff-4f88-9ce6-c46c98ff6c6f", "name": "network-vif-plugged", "status": "completed", "tag": "a7708761-35fd-489d-95c3-07dfd0a6964a"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:23.349628 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-fc963f61-bd14-4525-8113-8886fb7a8bd3 req-d1e53ea4-a377-41fb-b734-491853d9f8c6 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:23.350106 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-fc963f61-bd14-4525-8113-8886fb7a8bd3 req-d1e53ea4-a377-41fb-b734-491853d9f8c6 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:23.383138 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-fc963f61-bd14-4525-8113-8886fb7a8bd3 req-d1e53ea4-a377-41fb-b734-491853d9f8c6 service nova] Creating event network-vif-plugged:a7708761-35fd-489d-95c3-07dfd0a6964a for instance 26bca037-dbff-4f88-9ce6-c46c98ff6c6f on hv-cinder-83577 Mar 30 07:17:23.388663 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-fc963f61-bd14-4525-8113-8886fb7a8bd3 req-d1e53ea4-a377-41fb-b734-491853d9f8c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054554 Mar 30 07:17:23.389658 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 108/219] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:23.501532 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a70ccc56-04fc-42e2-98a6-3df2c6076380 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:23.510010 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a70ccc56-04fc-42e2-98a6-3df2c6076380 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.226358 Mar 30 07:17:23.510701 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 112/220] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:23 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:23.881548 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0778199f-d46e-47d2-93b7-f12a5da6e905 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:23.882346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0778199f-d46e-47d2-93b7-f12a5da6e905 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:23.890442 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0778199f-d46e-47d2-93b7-f12a5da6e905 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:23.890893 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0778199f-d46e-47d2-93b7-f12a5da6e905 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:23.891660 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0778199f-d46e-47d2-93b7-f12a5da6e905 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:23.892126 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0778199f-d46e-47d2-93b7-f12a5da6e905 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:24.028045 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-130b15fc-47c2-4afd-a6b7-e21912c6c566 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:24.028554 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-130b15fc-47c2-4afd-a6b7-e21912c6c566 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:24.030640 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0778199f-d46e-47d2-93b7-f12a5da6e905 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:24.035254 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-130b15fc-47c2-4afd-a6b7-e21912c6c566 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:24.035704 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-130b15fc-47c2-4afd-a6b7-e21912c6c566 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:24.036512 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-130b15fc-47c2-4afd-a6b7-e21912c6c566 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:24.036935 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-130b15fc-47c2-4afd-a6b7-e21912c6c566 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:24.038596 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0778199f-d46e-47d2-93b7-f12a5da6e905 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1314 microversion: 2.1 time: 0.164613 Mar 30 07:17:24.039167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 109/221] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:23 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:24.059682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-130b15fc-47c2-4afd-a6b7-e21912c6c566 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/ips" status: 200 len: 152 microversion: 2.20 time: 0.036008 Mar 30 07:17:24.060412 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 113/222] 10.222.0.20 () {60 vars in 1288 bytes} [Wed Mar 30 07:17:24 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:17:24.526385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2c730636-8b69-440f-89cb-336c880da249 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:24.526998 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2c730636-8b69-440f-89cb-336c880da249 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:24.533838 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c730636-8b69-440f-89cb-336c880da249 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:24.534449 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c730636-8b69-440f-89cb-336c880da249 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:24.535364 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c730636-8b69-440f-89cb-336c880da249 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:24.536195 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c730636-8b69-440f-89cb-336c880da249 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:24.676826 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2c730636-8b69-440f-89cb-336c880da249 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:24.686014 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2c730636-8b69-440f-89cb-336c880da249 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.163378 Mar 30 07:17:24.686570 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 110/223] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:24 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:25.056335 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c815331a-b3b5-4950-b026-faae3e15c508 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:25.057040 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c815331a-b3b5-4950-b026-faae3e15c508 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:25.063327 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c815331a-b3b5-4950-b026-faae3e15c508 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:25.063768 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c815331a-b3b5-4950-b026-faae3e15c508 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:25.064570 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c815331a-b3b5-4950-b026-faae3e15c508 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:25.065002 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c815331a-b3b5-4950-b026-faae3e15c508 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:25.199379 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c815331a-b3b5-4950-b026-faae3e15c508 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:25.210616 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c815331a-b3b5-4950-b026-faae3e15c508 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1314 microversion: 2.1 time: 0.158248 Mar 30 07:17:25.211768 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 114/224] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:25 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:25.703124 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5b01bb49-1937-4cd7-b954-75bbf31f13cc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:25.703725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5b01bb49-1937-4cd7-b954-75bbf31f13cc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:25.710480 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5b01bb49-1937-4cd7-b954-75bbf31f13cc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:25.710930 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5b01bb49-1937-4cd7-b954-75bbf31f13cc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:25.711688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5b01bb49-1937-4cd7-b954-75bbf31f13cc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:25.712160 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5b01bb49-1937-4cd7-b954-75bbf31f13cc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:25.854403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5b01bb49-1937-4cd7-b954-75bbf31f13cc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:25.863629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5b01bb49-1937-4cd7-b954-75bbf31f13cc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.164486 Mar 30 07:17:25.864534 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 111/225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:25 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:26.228919 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e4407be5-9afa-484e-939d-9502484b0aef tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:26.229544 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e4407be5-9afa-484e-939d-9502484b0aef tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:26.236830 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4407be5-9afa-484e-939d-9502484b0aef tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:26.237270 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4407be5-9afa-484e-939d-9502484b0aef tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:26.238059 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4407be5-9afa-484e-939d-9502484b0aef tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:26.238468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e4407be5-9afa-484e-939d-9502484b0aef tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:26.383769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e4407be5-9afa-484e-939d-9502484b0aef tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:26.391730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e4407be5-9afa-484e-939d-9502484b0aef tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1497 microversion: 2.1 time: 0.166665 Mar 30 07:17:26.392313 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 115/226] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:26 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:26.468112 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1994edb4-ee54-4e5c-9f85-3c6272c0dba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:26.468729 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1994edb4-ee54-4e5c-9f85-3c6272c0dba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:26.474644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1994edb4-ee54-4e5c-9f85-3c6272c0dba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:26.475091 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1994edb4-ee54-4e5c-9f85-3c6272c0dba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:26.475878 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1994edb4-ee54-4e5c-9f85-3c6272c0dba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:26.476312 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1994edb4-ee54-4e5c-9f85-3c6272c0dba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:26.504607 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-1994edb4-ee54-4e5c-9f85-3c6272c0dba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lazy-loading 'flavor' on Instance uuid d977a73f-876d-4d10-adf8-326ed77fc467 {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:17:26.789417 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1994edb4-ee54-4e5c-9f85-3c6272c0dba7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/action" status: 202 len: 0 microversion: 2.20 time: 0.325162 Mar 30 07:17:26.790241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 112/227] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Mar 30 07:17:26 2022] POST /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:17:26.799845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:26.800609 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:26.808078 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:26.808543 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:26.809777 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:26.810394 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:26.881736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cea39bf0-6a3d-42fa-a82b-b6a943902fda tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:26.882469 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cea39bf0-6a3d-42fa-a82b-b6a943902fda tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:26.889496 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cea39bf0-6a3d-42fa-a82b-b6a943902fda tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:26.890012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cea39bf0-6a3d-42fa-a82b-b6a943902fda tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:26.890836 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cea39bf0-6a3d-42fa-a82b-b6a943902fda tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:26.891260 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cea39bf0-6a3d-42fa-a82b-b6a943902fda tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:26.978432 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:26.987265 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:26.988820 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:26.989987 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e7c0aff2-73a6-468c-870a-2d645e421623 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.194372 Mar 30 07:17:26.990546 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 116/228] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:26 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:26.995079 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fcddbce3-a47f-400e-82a8-87baed534b07 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4c666f5-79bf-4be9-b681-f20d9a61483c"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:26.997300 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fcddbce3-a47f-400e-82a8-87baed534b07 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:27.003967 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fcddbce3-a47f-400e-82a8-87baed534b07 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:27.004540 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fcddbce3-a47f-400e-82a8-87baed534b07 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:27.005459 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fcddbce3-a47f-400e-82a8-87baed534b07 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:27.005890 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fcddbce3-a47f-400e-82a8-87baed534b07 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:27.046236 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cea39bf0-6a3d-42fa-a82b-b6a943902fda tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:27.053416 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cea39bf0-6a3d-42fa-a82b-b6a943902fda tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.175995 Mar 30 07:17:27.054523 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 113/229] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:26 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:27.297556 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fcddbce3-a47f-400e-82a8-87baed534b07 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305749 Mar 30 07:17:27.298145 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 117/230] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:17:26 2022] POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:27.416079 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a833f746-442b-4828-ac79-89f17414cc37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:27.416568 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a833f746-442b-4828-ac79-89f17414cc37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:27.422444 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a833f746-442b-4828-ac79-89f17414cc37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:27.422975 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a833f746-442b-4828-ac79-89f17414cc37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:27.423749 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a833f746-442b-4828-ac79-89f17414cc37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:27.424219 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a833f746-442b-4828-ac79-89f17414cc37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:27.447827 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a833f746-442b-4828-ac79-89f17414cc37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:17:27.540204 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a833f746-442b-4828-ac79-89f17414cc37 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "DELETE /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 204 len: 0 microversion: 2.1 time: 0.127645 Mar 30 07:17:27.541094 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 114/231] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:17:27 2022] DELETE /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:17:27.551463 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-20eba88c-2bcb-412d-882a-a3407ecd2357 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:27.552265 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-20eba88c-2bcb-412d-882a-a3407ecd2357 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:27.561950 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-20eba88c-2bcb-412d-882a-a3407ecd2357 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:27.562593 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-20eba88c-2bcb-412d-882a-a3407ecd2357 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:27.563757 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-20eba88c-2bcb-412d-882a-a3407ecd2357 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:27.564454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-20eba88c-2bcb-412d-882a-a3407ecd2357 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:27.708067 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-20eba88c-2bcb-412d-882a-a3407ecd2357 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:27.715984 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-20eba88c-2bcb-412d-882a-a3407ecd2357 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1503 microversion: 2.1 time: 0.170109 Mar 30 07:17:27.716808 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 118/232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:27 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:28.009772 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:28.010546 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:28.017351 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:28.017728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:28.018492 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:28.018925 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:28.072400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3f5b2fc5-95f9-4e7a-9c5e-15df64d1055d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:28.073006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3f5b2fc5-95f9-4e7a-9c5e-15df64d1055d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:28.079608 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3f5b2fc5-95f9-4e7a-9c5e-15df64d1055d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:28.080182 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3f5b2fc5-95f9-4e7a-9c5e-15df64d1055d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:28.080928 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3f5b2fc5-95f9-4e7a-9c5e-15df64d1055d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:28.081400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3f5b2fc5-95f9-4e7a-9c5e-15df64d1055d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:28.186668 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:28.195183 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:28.196686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:28.197959 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-41b66623-5581-4766-89fb-5a9b4585fd47 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.192830 Mar 30 07:17:28.198393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 115/233] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:28 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:28.254991 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3f5b2fc5-95f9-4e7a-9c5e-15df64d1055d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:28.262554 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3f5b2fc5-95f9-4e7a-9c5e-15df64d1055d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.193864 Mar 30 07:17:28.263319 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 119/234] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:28 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:28.734781 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d73d373d-ba14-45ca-94de-d8029553e834 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:28.735398 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d73d373d-ba14-45ca-94de-d8029553e834 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:28.741996 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d73d373d-ba14-45ca-94de-d8029553e834 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:28.742628 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d73d373d-ba14-45ca-94de-d8029553e834 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:28.743404 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d73d373d-ba14-45ca-94de-d8029553e834 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:28.743841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d73d373d-ba14-45ca-94de-d8029553e834 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:28.887468 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d73d373d-ba14-45ca-94de-d8029553e834 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:28.895576 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d73d373d-ba14-45ca-94de-d8029553e834 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1503 microversion: 2.1 time: 0.165555 Mar 30 07:17:28.896195 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 116/235] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:28 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:29.216350 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:29.217027 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:29.223779 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:29.224256 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:29.225043 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:29.225482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:29.284274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-13524d2d-5308-41f5-83da-246046d2899c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:29.285519 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-13524d2d-5308-41f5-83da-246046d2899c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:29.294325 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13524d2d-5308-41f5-83da-246046d2899c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:29.295071 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13524d2d-5308-41f5-83da-246046d2899c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:29.296033 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13524d2d-5308-41f5-83da-246046d2899c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:29.297459 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13524d2d-5308-41f5-83da-246046d2899c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:29.469518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:29.488129 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:29.496675 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:29.501776 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-121bedc9-a93d-4f57-ae94-02a6c8c9721d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.286879 Mar 30 07:17:29.502563 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 120/236] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:29 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:29.527704 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-13524d2d-5308-41f5-83da-246046d2899c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:29.535737 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-13524d2d-5308-41f5-83da-246046d2899c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.257067 Mar 30 07:17:29.536318 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 117/237] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:29 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:29.912895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b3a5cd08-ef58-4400-b72b-18f83e1b5c7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:29.913388 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b3a5cd08-ef58-4400-b72b-18f83e1b5c7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:29.919515 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3a5cd08-ef58-4400-b72b-18f83e1b5c7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:29.920001 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3a5cd08-ef58-4400-b72b-18f83e1b5c7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:29.921409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3a5cd08-ef58-4400-b72b-18f83e1b5c7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:29.921920 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3a5cd08-ef58-4400-b72b-18f83e1b5c7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:30.091435 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b3a5cd08-ef58-4400-b72b-18f83e1b5c7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:30.099373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b3a5cd08-ef58-4400-b72b-18f83e1b5c7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1503 microversion: 2.1 time: 0.190469 Mar 30 07:17:30.107682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 121/238] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:29 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:30.518625 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-f031a76f-1784-47f6-b6d7-c5c5074450e7 req-e7024a42-5854-497a-9727-79efc86f2637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bca037-dbff-4f88-9ce6-c46c98ff6c6f", "name": "network-vif-deleted", "tag": "a7708761-35fd-489d-95c3-07dfd0a6964a"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:30.523611 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:30.525234 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:30.530084 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-f031a76f-1784-47f6-b6d7-c5c5074450e7 req-e7024a42-5854-497a-9727-79efc86f2637 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:30.531238 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-f031a76f-1784-47f6-b6d7-c5c5074450e7 req-e7024a42-5854-497a-9727-79efc86f2637 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:30.533388 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:30.534050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:30.536089 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:30.536663 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:30.554243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-f031a76f-1784-47f6-b6d7-c5c5074450e7 req-e7024a42-5854-497a-9727-79efc86f2637 service nova] Creating event network-vif-deleted:a7708761-35fd-489d-95c3-07dfd0a6964a for instance 26bca037-dbff-4f88-9ce6-c46c98ff6c6f on hv-cinder-83577 Mar 30 07:17:30.559903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-f031a76f-1784-47f6-b6d7-c5c5074450e7 req-e7024a42-5854-497a-9727-79efc86f2637 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047554 Mar 30 07:17:30.561514 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 118/239] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:30.568441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6040edc6-0cc3-4b12-a99c-d6a3452c5153 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:30.569960 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6040edc6-0cc3-4b12-a99c-d6a3452c5153 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:30.579071 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6040edc6-0cc3-4b12-a99c-d6a3452c5153 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:30.580107 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6040edc6-0cc3-4b12-a99c-d6a3452c5153 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:30.581149 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6040edc6-0cc3-4b12-a99c-d6a3452c5153 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:30.581834 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6040edc6-0cc3-4b12-a99c-d6a3452c5153 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:30.828583 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:30.838846 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:30.840542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:30.841804 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bdb76c52-ebdd-4dc6-8267-467f51fb109f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.323818 Mar 30 07:17:30.842593 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 122/240] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:30 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:17:30.845317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6040edc6-0cc3-4b12-a99c-d6a3452c5153 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:30.858366 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6040edc6-0cc3-4b12-a99c-d6a3452c5153 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.295210 Mar 30 07:17:30.859046 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 119/241] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:30 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:31.117952 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:31.118561 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:31.125010 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:31.125696 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:31.126574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:31.127026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:31.166405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:31.166760 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:31.167232 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lazy-loading 'fault' on Instance uuid 26bca037-dbff-4f88-9ce6-c46c98ff6c6f {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:17:31.215060 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:31.224216 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-eddc5fa4-c020-40a7-9763-37ac96dcd90b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 200 len: 1304 microversion: 2.1 time: 0.110205 Mar 30 07:17:31.225217 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 123/242] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:31 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:31.860736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:31.861376 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:31.868188 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:31.868637 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:31.869395 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:31.869824 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:31.876368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-28d82a7e-2171-4dfe-b00f-6ad6321c913b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:31.877100 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-28d82a7e-2171-4dfe-b00f-6ad6321c913b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:31.884529 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-28d82a7e-2171-4dfe-b00f-6ad6321c913b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:31.885093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-28d82a7e-2171-4dfe-b00f-6ad6321c913b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:31.885953 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-28d82a7e-2171-4dfe-b00f-6ad6321c913b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:31.886526 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-28d82a7e-2171-4dfe-b00f-6ad6321c913b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:32.067966 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:32.076098 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:32.077760 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:32.079000 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0ea03e84-c846-4063-acfd-68c3215fc3f1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.222285 Mar 30 07:17:32.079619 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 120/243] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:31 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:32.092852 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-28d82a7e-2171-4dfe-b00f-6ad6321c913b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:32.100372 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-28d82a7e-2171-4dfe-b00f-6ad6321c913b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.228108 Mar 30 07:17:32.100970 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 124/244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:31 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:32.242847 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:32.243474 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: 26bca037-dbff-4f88-9ce6-c46c98ff6c6f] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:32.249766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:32.250223 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:32.250998 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:32.251596 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:32.269346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] HTTP exception thrown: Instance 26bca037-dbff-4f88-9ce6-c46c98ff6c6f could not be found. Mar 30 07:17:32.269963 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Returning 404 to user: Instance 26bca037-dbff-4f88-9ce6-c46c98ff6c6f could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:17:32.270798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-525ae6f2-b6eb-49c6-863f-51b6dbe7d860 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f" status: 404 len: 111 microversion: 2.1 time: 0.031810 Mar 30 07:17:32.271354 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 121/245] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:32 2022] GET /compute/v2.1/servers/26bca037-dbff-4f88-9ce6-c46c98ff6c6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:17:32.373594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-871279433", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "networks": [{"uuid": "6c352acd-aebe-4eb6-a0e7-b315ecb9a217"}]}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:32.432593 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] validate_networks() for [('6c352acd-aebe-4eb6-a0e7-b315ecb9a217', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:17:32.775368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:17:32.775787 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:17:32.776310 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:17:32.776745 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:17:32.777154 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:17:32.786168 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:32.786614 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:32.787403 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:32.787899 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:32.804788 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Getting quotas for project c7ad5fa9994340d78e5489bc40885480. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:17:32.808737 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Getting quotas for user 23be35231cd6493e917259e81b849c8d and project c7ad5fa9994340d78e5489bc40885480. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:17:32.819644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:17:32.821900 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:17:32.868422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-27f227a7-45bd-4318-b44f-824fa75985bf tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498967 Mar 30 07:17:32.869066 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 125/246] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:17:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:17:32.879127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1f0f8be6-ba54-4b98-898f-4dd1b5977047 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:32.879730 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1f0f8be6-ba54-4b98-898f-4dd1b5977047 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:32.933181 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1f0f8be6-ba54-4b98-898f-4dd1b5977047 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:32.939981 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1f0f8be6-ba54-4b98-898f-4dd1b5977047 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1213 microversion: 2.1 time: 0.064640 Mar 30 07:17:32.940535 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 122/247] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:32 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:33.098466 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:33.099080 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:33.105271 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:33.106094 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:33.106870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:33.107304 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:33.118146 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-99ce91d7-997a-4e85-b46b-80df41e7dbd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:33.118715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-99ce91d7-997a-4e85-b46b-80df41e7dbd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:33.125727 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-99ce91d7-997a-4e85-b46b-80df41e7dbd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:33.126151 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-99ce91d7-997a-4e85-b46b-80df41e7dbd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:33.127096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-99ce91d7-997a-4e85-b46b-80df41e7dbd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:33.127697 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-99ce91d7-997a-4e85-b46b-80df41e7dbd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:33.318952 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:33.328702 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:33.330220 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:33.331444 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-65e8a60e-cac8-483f-9b76-ac0d3785720b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.237566 Mar 30 07:17:33.332258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 126/248] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:33 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:33.342759 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-99ce91d7-997a-4e85-b46b-80df41e7dbd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:33.351609 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-99ce91d7-997a-4e85-b46b-80df41e7dbd8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.237298 Mar 30 07:17:33.352434 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 123/249] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:33 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:33.956747 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-21857d65-d438-4019-8992-a0ea992f0d3d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:33.957631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-21857d65-d438-4019-8992-a0ea992f0d3d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:33.966002 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-21857d65-d438-4019-8992-a0ea992f0d3d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:33.966118 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-21857d65-d438-4019-8992-a0ea992f0d3d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:33.966912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-21857d65-d438-4019-8992-a0ea992f0d3d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:33.967405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-21857d65-d438-4019-8992-a0ea992f0d3d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:34.043951 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-21857d65-d438-4019-8992-a0ea992f0d3d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:34.053623 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-21857d65-d438-4019-8992-a0ea992f0d3d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1273 microversion: 2.1 time: 0.100715 Mar 30 07:17:34.055841 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 127/250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:33 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:34.350894 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:34.351511 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:34.358725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:34.359175 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:34.359980 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:34.360402 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:34.369907 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c8f97310-f7db-49ef-a01f-f246574d846b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:34.370677 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c8f97310-f7db-49ef-a01f-f246574d846b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:34.377314 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c8f97310-f7db-49ef-a01f-f246574d846b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:34.377748 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c8f97310-f7db-49ef-a01f-f246574d846b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:34.378730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c8f97310-f7db-49ef-a01f-f246574d846b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:34.379792 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c8f97310-f7db-49ef-a01f-f246574d846b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:34.586743 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:34.598061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:34.600956 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:34.602852 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cd6d54bd-b061-45bf-8d4f-24dcc87bdcc5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.255978 Mar 30 07:17:34.603961 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 124/251] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:34 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:34.616489 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c8f97310-f7db-49ef-a01f-f246574d846b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:34.624831 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c8f97310-f7db-49ef-a01f-f246574d846b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.258839 Mar 30 07:17:34.634754 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 128/252] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:34 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:34.932151 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a6ec7306-3b24-4fee-adb4-92bab9374541 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:34.938137 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6ec7306-3b24-4fee-adb4-92bab9374541 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:34.938572 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6ec7306-3b24-4fee-adb4-92bab9374541 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.001338 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a6ec7306-3b24-4fee-adb4-92bab9374541 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Going to try to stop instance {{(pid=117063) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 30 07:17:35.048309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a6ec7306-3b24-4fee-adb4-92bab9374541 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/action" status: 202 len: 0 microversion: 2.1 time: 0.120044 Mar 30 07:17:35.049092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 125/253] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:17:34 2022] POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:17:35.057037 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5178dbac-b2ba-4acb-b72c-96e27d6ae7f9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:35.057865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5178dbac-b2ba-4acb-b72c-96e27d6ae7f9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:35.064941 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5178dbac-b2ba-4acb-b72c-96e27d6ae7f9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.065761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5178dbac-b2ba-4acb-b72c-96e27d6ae7f9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.073232 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5178dbac-b2ba-4acb-b72c-96e27d6ae7f9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.073875 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5178dbac-b2ba-4acb-b72c-96e27d6ae7f9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.081909 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4a21d677-55f7-4a2e-b668-35ccd1edbb55 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:35.082725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4a21d677-55f7-4a2e-b668-35ccd1edbb55 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:35.090061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4a21d677-55f7-4a2e-b668-35ccd1edbb55 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.090719 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4a21d677-55f7-4a2e-b668-35ccd1edbb55 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.093346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4a21d677-55f7-4a2e-b668-35ccd1edbb55 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.093844 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4a21d677-55f7-4a2e-b668-35ccd1edbb55 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.331360 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5178dbac-b2ba-4acb-b72c-96e27d6ae7f9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:35.339713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5178dbac-b2ba-4acb-b72c-96e27d6ae7f9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.286448 Mar 30 07:17:35.340571 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 129/254] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:35 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:35.352983 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4a21d677-55f7-4a2e-b668-35ccd1edbb55 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:35.361110 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4a21d677-55f7-4a2e-b668-35ccd1edbb55 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.293895 Mar 30 07:17:35.361737 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 126/255] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:35 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:35.388441 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-21610928-229a-4cde-b0cf-9af86252d16f req-2e4d88ce-b429-43f6-a6fc-1ceaa6d69c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a18d09-8837-41b4-86c1-5cf12a63233c", "tag": "b5568592-f745-4f0c-9973-1c35f4a53778"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:35.399578 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-21610928-229a-4cde-b0cf-9af86252d16f req-2e4d88ce-b429-43f6-a6fc-1ceaa6d69c10 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.400255 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-21610928-229a-4cde-b0cf-9af86252d16f req-2e4d88ce-b429-43f6-a6fc-1ceaa6d69c10 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.414367 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-21610928-229a-4cde-b0cf-9af86252d16f req-2e4d88ce-b429-43f6-a6fc-1ceaa6d69c10 service nova] Creating event network-changed:b5568592-f745-4f0c-9973-1c35f4a53778 for instance f8a18d09-8837-41b4-86c1-5cf12a63233c on hv-cinder-83577 Mar 30 07:17:35.419337 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-21610928-229a-4cde-b0cf-9af86252d16f req-2e4d88ce-b429-43f6-a6fc-1ceaa6d69c10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034549 Mar 30 07:17:35.420048 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 130/256] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:35.623184 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:35.623933 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:35.630405 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.630844 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.631682 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.632158 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.648233 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ac8d14cc-4101-4fb1-8980-50b4c3e21605 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:35.649113 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ac8d14cc-4101-4fb1-8980-50b4c3e21605 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:35.656965 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ac8d14cc-4101-4fb1-8980-50b4c3e21605 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.657869 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ac8d14cc-4101-4fb1-8980-50b4c3e21605 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.658962 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ac8d14cc-4101-4fb1-8980-50b4c3e21605 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.659513 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ac8d14cc-4101-4fb1-8980-50b4c3e21605 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.847712 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:35.850531 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ac8d14cc-4101-4fb1-8980-50b4c3e21605 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:35.857154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:35.858963 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ac8d14cc-4101-4fb1-8980-50b4c3e21605 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.220322 Mar 30 07:17:35.859101 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:35.859696 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 131/257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:35 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:35.861077 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-8c5d8531-6491-44ad-bc99-3a3a9dec6ec9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.241888 Mar 30 07:17:35.869569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 127/258] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:35 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:35.901405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2eb6b50a-12f9-44bb-b78b-fb540fe9f054 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13e67636-b806-4734-82a7-cd5057c77f46", "device": "/dev/sdb"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:35.902966 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2eb6b50a-12f9-44bb-b78b-fb540fe9f054 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:35.909059 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2eb6b50a-12f9-44bb-b78b-fb540fe9f054 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.909521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2eb6b50a-12f9-44bb-b78b-fb540fe9f054 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:35.910271 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2eb6b50a-12f9-44bb-b78b-fb540fe9f054 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:35.910694 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2eb6b50a-12f9-44bb-b78b-fb540fe9f054 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:36.186231 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2eb6b50a-12f9-44bb-b78b-fb540fe9f054 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "POST /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288726 Mar 30 07:17:36.191561 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 132/259] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:17:35 2022] POST /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:36.357691 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0fb71417-fb8b-4b3f-a4a1-2f4c6477c4da tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:36.358378 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0fb71417-fb8b-4b3f-a4a1-2f4c6477c4da tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:36.364892 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0fb71417-fb8b-4b3f-a4a1-2f4c6477c4da tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:36.365237 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0fb71417-fb8b-4b3f-a4a1-2f4c6477c4da tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:36.365994 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0fb71417-fb8b-4b3f-a4a1-2f4c6477c4da tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:36.366424 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0fb71417-fb8b-4b3f-a4a1-2f4c6477c4da tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:36.378686 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-830dc220-4c8d-4535-ae4b-2dd53e41bf76 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:36.379582 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-830dc220-4c8d-4535-ae4b-2dd53e41bf76 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:36.392409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-830dc220-4c8d-4535-ae4b-2dd53e41bf76 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:36.392992 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-830dc220-4c8d-4535-ae4b-2dd53e41bf76 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:36.395938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-830dc220-4c8d-4535-ae4b-2dd53e41bf76 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:36.396384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-830dc220-4c8d-4535-ae4b-2dd53e41bf76 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:36.584458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0fb71417-fb8b-4b3f-a4a1-2f4c6477c4da tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:36.592365 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0fb71417-fb8b-4b3f-a4a1-2f4c6477c4da tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.238973 Mar 30 07:17:36.593141 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 128/260] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:36 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:36.612208 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-830dc220-4c8d-4535-ae4b-2dd53e41bf76 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:36.623703 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-830dc220-4c8d-4535-ae4b-2dd53e41bf76 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.249424 Mar 30 07:17:36.624366 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 133/261] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:36 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:36.876879 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-80ca408c-1068-4820-8415-26a8db53532f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:36.877420 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-80ca408c-1068-4820-8415-26a8db53532f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:36.881022 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:36.881673 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:36.883611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-80ca408c-1068-4820-8415-26a8db53532f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:36.884104 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-80ca408c-1068-4820-8415-26a8db53532f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:36.884889 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-80ca408c-1068-4820-8415-26a8db53532f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:36.885320 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-80ca408c-1068-4820-8415-26a8db53532f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:36.888236 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:36.890191 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:36.890191 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:36.890191 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:37.094358 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-80ca408c-1068-4820-8415-26a8db53532f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:37.097049 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:37.102493 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-80ca408c-1068-4820-8415-26a8db53532f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.229863 Mar 30 07:17:37.103163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 129/262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:36 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:37.106147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:37.107647 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:37.109469 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d52c1007-1890-4d40-868d-c366e15bf8d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.232246 Mar 30 07:17:37.110169 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 134/263] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:36 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:37.610783 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-73afde7a-ea6f-4ee5-9c98-85b4f26e415e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:37.611474 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-73afde7a-ea6f-4ee5-9c98-85b4f26e415e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:37.618842 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-73afde7a-ea6f-4ee5-9c98-85b4f26e415e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:37.619376 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-73afde7a-ea6f-4ee5-9c98-85b4f26e415e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:37.620188 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-73afde7a-ea6f-4ee5-9c98-85b4f26e415e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:37.620625 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-73afde7a-ea6f-4ee5-9c98-85b4f26e415e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:37.649613 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e34b7573-5e43-4a03-9cec-5027b8b0101b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:37.650226 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e34b7573-5e43-4a03-9cec-5027b8b0101b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:37.663032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e34b7573-5e43-4a03-9cec-5027b8b0101b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:37.663494 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e34b7573-5e43-4a03-9cec-5027b8b0101b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:37.664295 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e34b7573-5e43-4a03-9cec-5027b8b0101b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:37.664706 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e34b7573-5e43-4a03-9cec-5027b8b0101b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:37.810741 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-73afde7a-ea6f-4ee5-9c98-85b4f26e415e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:37.819060 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-73afde7a-ea6f-4ee5-9c98-85b4f26e415e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.212702 Mar 30 07:17:37.819642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 130/264] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:37 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:37.854787 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e34b7573-5e43-4a03-9cec-5027b8b0101b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:37.863379 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e34b7573-5e43-4a03-9cec-5027b8b0101b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.226678 Mar 30 07:17:37.864019 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 135/265] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:37 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:38.122282 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-03ad0f5a-c164-4ae3-8f2c-e46a55138ecf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:38.123199 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-03ad0f5a-c164-4ae3-8f2c-e46a55138ecf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:38.128390 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:38.129147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:38.131343 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03ad0f5a-c164-4ae3-8f2c-e46a55138ecf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:38.131939 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03ad0f5a-c164-4ae3-8f2c-e46a55138ecf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:38.132895 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03ad0f5a-c164-4ae3-8f2c-e46a55138ecf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:38.133453 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03ad0f5a-c164-4ae3-8f2c-e46a55138ecf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:38.137034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:38.137304 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:38.138261 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:38.138794 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:38.347294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:38.350764 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-03ad0f5a-c164-4ae3-8f2c-e46a55138ecf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:38.356134 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:38.357806 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:38.358918 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-03ad0f5a-c164-4ae3-8f2c-e46a55138ecf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.241606 Mar 30 07:17:38.359107 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4dfa5c81-44d2-4b6a-8495-d017f6a8acf4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.235571 Mar 30 07:17:38.359484 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 131/266] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:38 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:38.359824 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 136/267] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:38 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:38.836497 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7249a102-0b47-4135-bf20-47a9ccbeb9d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:38.837099 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7249a102-0b47-4135-bf20-47a9ccbeb9d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:38.843682 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7249a102-0b47-4135-bf20-47a9ccbeb9d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:38.844173 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7249a102-0b47-4135-bf20-47a9ccbeb9d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:38.845225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7249a102-0b47-4135-bf20-47a9ccbeb9d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:38.845666 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7249a102-0b47-4135-bf20-47a9ccbeb9d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:38.880412 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0eee6147-12d5-4969-b51f-d973314a0960 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:38.881066 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0eee6147-12d5-4969-b51f-d973314a0960 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:38.887601 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0eee6147-12d5-4969-b51f-d973314a0960 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:38.888155 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0eee6147-12d5-4969-b51f-d973314a0960 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:38.889039 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0eee6147-12d5-4969-b51f-d973314a0960 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:38.889512 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0eee6147-12d5-4969-b51f-d973314a0960 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:39.010189 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7249a102-0b47-4135-bf20-47a9ccbeb9d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:39.028557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7249a102-0b47-4135-bf20-47a9ccbeb9d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.196289 Mar 30 07:17:39.029187 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 132/268] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:38 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:39.092154 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0eee6147-12d5-4969-b51f-d973314a0960 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:39.099796 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0eee6147-12d5-4969-b51f-d973314a0960 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.223187 Mar 30 07:17:39.100413 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 137/269] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:38 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:39.376733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-db66015c-14a1-406a-a526-3073e4f24a36 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:39.377630 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-db66015c-14a1-406a-a526-3073e4f24a36 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:39.378942 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:39.379905 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:39.385024 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-db66015c-14a1-406a-a526-3073e4f24a36 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:39.385670 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-db66015c-14a1-406a-a526-3073e4f24a36 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:39.386588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:39.387223 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:39.387678 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-db66015c-14a1-406a-a526-3073e4f24a36 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:39.388160 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:39.388600 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:39.388821 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-db66015c-14a1-406a-a526-3073e4f24a36 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:39.584561 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:39.591282 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-db66015c-14a1-406a-a526-3073e4f24a36 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:39.592640 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:39.594295 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:39.596110 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-8c05c37f-3a6c-4e8e-b846-6cf7d271beb7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.222045 Mar 30 07:17:39.596686 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 138/270] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:39 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:39.599289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-db66015c-14a1-406a-a526-3073e4f24a36 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.226919 Mar 30 07:17:39.599880 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 133/271] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:39 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:40.049528 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-72081d88-5e89-4473-8f67-7c1e88bc4cc6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:40.050287 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-72081d88-5e89-4473-8f67-7c1e88bc4cc6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:40.058292 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72081d88-5e89-4473-8f67-7c1e88bc4cc6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:40.058856 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72081d88-5e89-4473-8f67-7c1e88bc4cc6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:40.059799 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72081d88-5e89-4473-8f67-7c1e88bc4cc6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:40.060382 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72081d88-5e89-4473-8f67-7c1e88bc4cc6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:40.117707 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-35c8b303-2906-40c8-9389-12d708ba2436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:40.118240 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-35c8b303-2906-40c8-9389-12d708ba2436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:40.128171 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-35c8b303-2906-40c8-9389-12d708ba2436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:40.128617 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-35c8b303-2906-40c8-9389-12d708ba2436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:40.129392 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-35c8b303-2906-40c8-9389-12d708ba2436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:40.129817 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-35c8b303-2906-40c8-9389-12d708ba2436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:40.237133 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-72081d88-5e89-4473-8f67-7c1e88bc4cc6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:40.246246 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-72081d88-5e89-4473-8f67-7c1e88bc4cc6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.202913 Mar 30 07:17:40.246849 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 139/272] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:40 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:40.299767 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-35c8b303-2906-40c8-9389-12d708ba2436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:40.307581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-35c8b303-2906-40c8-9389-12d708ba2436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.193896 Mar 30 07:17:40.308199 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 134/273] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:40 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:40.620136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:40.621057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:40.622814 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-38e6f908-3785-42bd-9331-e38445a147d2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:40.623579 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-38e6f908-3785-42bd-9331-e38445a147d2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:40.628604 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:40.629048 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:40.629832 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:40.630256 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:40.630485 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-38e6f908-3785-42bd-9331-e38445a147d2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:40.630949 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-38e6f908-3785-42bd-9331-e38445a147d2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:40.631703 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-38e6f908-3785-42bd-9331-e38445a147d2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:40.632167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-38e6f908-3785-42bd-9331-e38445a147d2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:40.825041 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:40.828304 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-38e6f908-3785-42bd-9331-e38445a147d2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:40.833314 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:40.834801 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:40.835980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-59cb9e0e-e2da-48de-8c61-fc857bfc750f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.220715 Mar 30 07:17:40.836330 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-38e6f908-3785-42bd-9331-e38445a147d2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.218250 Mar 30 07:17:40.837084 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 140/274] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:40 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:17:40.837335 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 135/275] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:40 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:41.267751 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2457d4f5-07c2-452e-ac42-eb3af760bcfb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:41.268862 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2457d4f5-07c2-452e-ac42-eb3af760bcfb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:41.279660 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2457d4f5-07c2-452e-ac42-eb3af760bcfb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:41.280436 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2457d4f5-07c2-452e-ac42-eb3af760bcfb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:41.281705 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2457d4f5-07c2-452e-ac42-eb3af760bcfb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:41.282407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2457d4f5-07c2-452e-ac42-eb3af760bcfb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:41.324840 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-31f9a9c4-8c42-4f6e-8c56-cc3a50fcf6b4 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:41.325398 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-31f9a9c4-8c42-4f6e-8c56-cc3a50fcf6b4 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:41.332627 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31f9a9c4-8c42-4f6e-8c56-cc3a50fcf6b4 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:41.333140 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31f9a9c4-8c42-4f6e-8c56-cc3a50fcf6b4 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:41.333969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31f9a9c4-8c42-4f6e-8c56-cc3a50fcf6b4 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:41.334415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31f9a9c4-8c42-4f6e-8c56-cc3a50fcf6b4 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:41.454544 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2457d4f5-07c2-452e-ac42-eb3af760bcfb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:41.463063 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2457d4f5-07c2-452e-ac42-eb3af760bcfb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.201700 Mar 30 07:17:41.463661 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 141/276] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:41 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:41.497769 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-31f9a9c4-8c42-4f6e-8c56-cc3a50fcf6b4 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:41.505240 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-31f9a9c4-8c42-4f6e-8c56-cc3a50fcf6b4 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.184267 Mar 30 07:17:41.505809 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 136/277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:41 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:41.858425 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2f838e1e-5032-443d-80f2-67ded775b7a4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:41.858770 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:41.859422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2f838e1e-5032-443d-80f2-67ded775b7a4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:41.859675 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:41.869613 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:41.869884 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f838e1e-5032-443d-80f2-67ded775b7a4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:41.870361 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:41.870650 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f838e1e-5032-443d-80f2-67ded775b7a4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:41.871622 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:41.871899 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f838e1e-5032-443d-80f2-67ded775b7a4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:41.872394 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:41.872621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f838e1e-5032-443d-80f2-67ded775b7a4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:42.067880 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2f838e1e-5032-443d-80f2-67ded775b7a4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:42.070806 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:42.076368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2f838e1e-5032-443d-80f2-67ded775b7a4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.224574 Mar 30 07:17:42.076915 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 142/278] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:41 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:42.080759 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:42.082649 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:42.084308 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-159fbf82-6616-453b-8bc4-f48b99d8cf49 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.232703 Mar 30 07:17:42.085089 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 137/279] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:41 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:42.485006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b534eb3e-2ee4-4b41-93e9-c1a2a25d2e10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:42.486049 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b534eb3e-2ee4-4b41-93e9-c1a2a25d2e10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:42.493877 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b534eb3e-2ee4-4b41-93e9-c1a2a25d2e10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:42.494402 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b534eb3e-2ee4-4b41-93e9-c1a2a25d2e10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:42.495302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b534eb3e-2ee4-4b41-93e9-c1a2a25d2e10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:42.495855 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b534eb3e-2ee4-4b41-93e9-c1a2a25d2e10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:42.522501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-599fe03a-8004-49c7-bb1a-5e059b7c8c0d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:42.523059 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-599fe03a-8004-49c7-bb1a-5e059b7c8c0d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:42.530322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-599fe03a-8004-49c7-bb1a-5e059b7c8c0d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:42.530771 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-599fe03a-8004-49c7-bb1a-5e059b7c8c0d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:42.531539 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-599fe03a-8004-49c7-bb1a-5e059b7c8c0d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:42.532005 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-599fe03a-8004-49c7-bb1a-5e059b7c8c0d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:42.686350 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b534eb3e-2ee4-4b41-93e9-c1a2a25d2e10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:42.695730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b534eb3e-2ee4-4b41-93e9-c1a2a25d2e10 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.217665 Mar 30 07:17:42.696436 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 143/280] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:42 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:42.716674 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-599fe03a-8004-49c7-bb1a-5e059b7c8c0d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:42.725853 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-599fe03a-8004-49c7-bb1a-5e059b7c8c0d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.207221 Mar 30 07:17:42.726412 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 138/281] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:42 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:43.099200 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-56c217d4-422b-4dfb-b6d4-be98062fc359 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:43.100135 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-56c217d4-422b-4dfb-b6d4-be98062fc359 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:43.106806 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:43.107854 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:43.111218 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56c217d4-422b-4dfb-b6d4-be98062fc359 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:43.111694 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56c217d4-422b-4dfb-b6d4-be98062fc359 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:43.112510 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56c217d4-422b-4dfb-b6d4-be98062fc359 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:43.112949 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56c217d4-422b-4dfb-b6d4-be98062fc359 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:43.114844 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:43.115300 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:43.116123 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:43.116564 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:43.306058 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-56c217d4-422b-4dfb-b6d4-be98062fc359 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:43.310110 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:43.314159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-56c217d4-422b-4dfb-b6d4-be98062fc359 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.222171 Mar 30 07:17:43.314779 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 144/282] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:43 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:43.319269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:43.320810 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:43.321992 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fbc5ea09-7cd8-4ab1-8a6d-cf6de6147ed4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.222162 Mar 30 07:17:43.322497 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 139/283] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:43 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:43.713669 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c7a80e67-b8ea-4297-a086-379c8de692b6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:43.714372 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c7a80e67-b8ea-4297-a086-379c8de692b6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:43.721197 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c7a80e67-b8ea-4297-a086-379c8de692b6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:43.721647 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c7a80e67-b8ea-4297-a086-379c8de692b6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:43.722430 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c7a80e67-b8ea-4297-a086-379c8de692b6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:43.722862 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c7a80e67-b8ea-4297-a086-379c8de692b6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:43.743293 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6c6af6d1-42fa-492e-9696-4cc2a1b9bb44 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:43.743916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6c6af6d1-42fa-492e-9696-4cc2a1b9bb44 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:43.751179 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c6af6d1-42fa-492e-9696-4cc2a1b9bb44 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:43.751875 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c6af6d1-42fa-492e-9696-4cc2a1b9bb44 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:43.752752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c6af6d1-42fa-492e-9696-4cc2a1b9bb44 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:43.753306 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c6af6d1-42fa-492e-9696-4cc2a1b9bb44 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:43.950090 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c7a80e67-b8ea-4297-a086-379c8de692b6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:43.954101 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6c6af6d1-42fa-492e-9696-4cc2a1b9bb44 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:43.958291 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c7a80e67-b8ea-4297-a086-379c8de692b6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.248444 Mar 30 07:17:43.958877 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 145/284] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:43 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:43.962315 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6c6af6d1-42fa-492e-9696-4cc2a1b9bb44 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.223003 Mar 30 07:17:43.962897 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 140/285] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:43 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:44.332128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fac956cd-1fb7-4487-a08d-05d818f70a00 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:44.332735 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fac956cd-1fb7-4487-a08d-05d818f70a00 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:44.348848 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fac956cd-1fb7-4487-a08d-05d818f70a00 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.348968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:44.349092 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fac956cd-1fb7-4487-a08d-05d818f70a00 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:44.349188 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:44.349275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fac956cd-1fb7-4487-a08d-05d818f70a00 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.349275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fac956cd-1fb7-4487-a08d-05d818f70a00 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:44.349452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.349452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:44.349452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.349452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:44.553594 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:44.558412 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fac956cd-1fb7-4487-a08d-05d818f70a00 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:44.563518 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:44.565350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:44.566385 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fac956cd-1fb7-4487-a08d-05d818f70a00 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.239023 Mar 30 07:17:44.567109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-023cd8f3-c690-4b27-9be3-885374479dce tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.230650 Mar 30 07:17:44.575486 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 141/286] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:44 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:17:44.575784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 146/287] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:44 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:44.950344 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-788979d2-df99-4a4d-8e90-c8e9d3a2cd53 req-67ed5e6d-ba61-4bc2-89a3-0d2c89514cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a18d09-8837-41b4-86c1-5cf12a63233c", "name": "network-vif-plugged", "status": "completed", "tag": "b5568592-f745-4f0c-9973-1c35f4a53778"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:44.963907 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-788979d2-df99-4a4d-8e90-c8e9d3a2cd53 req-67ed5e6d-ba61-4bc2-89a3-0d2c89514cfb service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.964377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-788979d2-df99-4a4d-8e90-c8e9d3a2cd53 req-67ed5e6d-ba61-4bc2-89a3-0d2c89514cfb service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:44.975651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-56b7869b-a56a-4760-b11e-55d9e1981879 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:44.976873 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-56b7869b-a56a-4760-b11e-55d9e1981879 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:44.977833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-788979d2-df99-4a4d-8e90-c8e9d3a2cd53 req-67ed5e6d-ba61-4bc2-89a3-0d2c89514cfb service nova] Creating event network-vif-plugged:b5568592-f745-4f0c-9973-1c35f4a53778 for instance f8a18d09-8837-41b4-86c1-5cf12a63233c on hv-cinder-83577 Mar 30 07:17:44.983265 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-788979d2-df99-4a4d-8e90-c8e9d3a2cd53 req-67ed5e6d-ba61-4bc2-89a3-0d2c89514cfb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036955 Mar 30 07:17:44.983887 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 142/288] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:17:44.984005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56b7869b-a56a-4760-b11e-55d9e1981879 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.984517 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56b7869b-a56a-4760-b11e-55d9e1981879 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:44.985303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56b7869b-a56a-4760-b11e-55d9e1981879 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.985741 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56b7869b-a56a-4760-b11e-55d9e1981879 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:44.989356 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e1e85c74-ab7e-446c-a416-568f8b8949e6 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:44.990236 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e1e85c74-ab7e-446c-a416-568f8b8949e6 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:44.997887 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e1e85c74-ab7e-446c-a416-568f8b8949e6 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.998504 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e1e85c74-ab7e-446c-a416-568f8b8949e6 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:44.999272 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e1e85c74-ab7e-446c-a416-568f8b8949e6 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:44.999958 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e1e85c74-ab7e-446c-a416-568f8b8949e6 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:45.390848 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-56b7869b-a56a-4760-b11e-55d9e1981879 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:45.394296 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e1e85c74-ab7e-446c-a416-568f8b8949e6 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:45.401294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-56b7869b-a56a-4760-b11e-55d9e1981879 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.429890 Mar 30 07:17:45.401792 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e1e85c74-ab7e-446c-a416-568f8b8949e6 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.416542 Mar 30 07:17:45.401923 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 147/289] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:44 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:45.402674 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 143/290] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:44 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:45.587485 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3ada3a42-8cc0-4ea4-b9a0-1474e2ae07c9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:45.588517 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3ada3a42-8cc0-4ea4-b9a0-1474e2ae07c9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:45.589676 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:45.590670 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:45.597504 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3ada3a42-8cc0-4ea4-b9a0-1474e2ae07c9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:45.597951 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3ada3a42-8cc0-4ea4-b9a0-1474e2ae07c9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:45.598727 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3ada3a42-8cc0-4ea4-b9a0-1474e2ae07c9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:45.598856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:45.599155 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3ada3a42-8cc0-4ea4-b9a0-1474e2ae07c9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:45.599288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:45.599950 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:45.600377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:45.791990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:45.795137 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3ada3a42-8cc0-4ea4-b9a0-1474e2ae07c9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:45.800218 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:45.801710 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:45.802903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-154cfb02-63e1-4314-beeb-6428d5d502b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.219727 Mar 30 07:17:45.803104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3ada3a42-8cc0-4ea4-b9a0-1474e2ae07c9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.222134 Mar 30 07:17:45.803498 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 144/291] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:45 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:45.803729 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 148/292] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:45 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:46.420771 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8f24ca2c-ddb7-45c7-b6d0-08b9a8db8a2f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:46.421422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5b7d85e6-4ec9-4996-a0da-e3be57b0a05d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:46.421853 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-8f24ca2c-ddb7-45c7-b6d0-08b9a8db8a2f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:46.421958 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5b7d85e6-4ec9-4996-a0da-e3be57b0a05d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:46.429851 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b7d85e6-4ec9-4996-a0da-e3be57b0a05d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:46.430227 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8f24ca2c-ddb7-45c7-b6d0-08b9a8db8a2f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:46.430416 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b7d85e6-4ec9-4996-a0da-e3be57b0a05d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:46.430785 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8f24ca2c-ddb7-45c7-b6d0-08b9a8db8a2f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:46.431331 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b7d85e6-4ec9-4996-a0da-e3be57b0a05d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:46.431735 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8f24ca2c-ddb7-45c7-b6d0-08b9a8db8a2f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:46.431979 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b7d85e6-4ec9-4996-a0da-e3be57b0a05d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:46.432312 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8f24ca2c-ddb7-45c7-b6d0-08b9a8db8a2f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:46.653100 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-8f24ca2c-ddb7-45c7-b6d0-08b9a8db8a2f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:46.657076 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5b7d85e6-4ec9-4996-a0da-e3be57b0a05d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:46.661584 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-8f24ca2c-ddb7-45c7-b6d0-08b9a8db8a2f tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.245719 Mar 30 07:17:46.662348 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 145/293] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:46 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:46.665796 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5b7d85e6-4ec9-4996-a0da-e3be57b0a05d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.249548 Mar 30 07:17:46.666408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 149/294] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:46 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:46.824424 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9e6a4332-49bb-4ec7-b050-9562961f4804 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:46.824919 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:46.825397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9e6a4332-49bb-4ec7-b050-9562961f4804 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:46.825933 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:46.833584 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:46.833735 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e6a4332-49bb-4ec7-b050-9562961f4804 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:46.834022 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:46.834129 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e6a4332-49bb-4ec7-b050-9562961f4804 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:46.834843 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:46.834995 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e6a4332-49bb-4ec7-b050-9562961f4804 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:46.835265 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:46.835419 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e6a4332-49bb-4ec7-b050-9562961f4804 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:47.037669 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9e6a4332-49bb-4ec7-b050-9562961f4804 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:47.040738 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:47.045114 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9e6a4332-49bb-4ec7-b050-9562961f4804 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.227175 Mar 30 07:17:47.045730 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 146/295] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:46 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:47.049603 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:47.051124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:47.052321 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1dadaa18-11d8-495e-a2cc-98b959aa77a2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.233923 Mar 30 07:17:47.052861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 150/296] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:46 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:47.679585 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3747fad1-2574-45b6-9cbe-266c8792ec31 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:47.680360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3747fad1-2574-45b6-9cbe-266c8792ec31 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:47.683217 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-68936bcb-e4ce-422e-b8b9-e3a7e3932efb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:47.683833 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-68936bcb-e4ce-422e-b8b9-e3a7e3932efb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:47.687064 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3747fad1-2574-45b6-9cbe-266c8792ec31 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:47.687510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3747fad1-2574-45b6-9cbe-266c8792ec31 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:47.688282 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3747fad1-2574-45b6-9cbe-266c8792ec31 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:47.688706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3747fad1-2574-45b6-9cbe-266c8792ec31 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:47.690500 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68936bcb-e4ce-422e-b8b9-e3a7e3932efb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:47.690952 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68936bcb-e4ce-422e-b8b9-e3a7e3932efb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:47.691720 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68936bcb-e4ce-422e-b8b9-e3a7e3932efb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:47.692183 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68936bcb-e4ce-422e-b8b9-e3a7e3932efb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:47.881915 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3747fad1-2574-45b6-9cbe-266c8792ec31 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:47.885084 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-68936bcb-e4ce-422e-b8b9-e3a7e3932efb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:47.889359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3747fad1-2574-45b6-9cbe-266c8792ec31 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.213817 Mar 30 07:17:47.889903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 147/297] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:47 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:47.894821 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-68936bcb-e4ce-422e-b8b9-e3a7e3932efb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.215307 Mar 30 07:17:47.895630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 151/298] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:47 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:48.061526 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9729d486-f036-4d13-9080-12d9bd1ad2fe tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:48.062145 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9729d486-f036-4d13-9080-12d9bd1ad2fe tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:48.068845 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9729d486-f036-4d13-9080-12d9bd1ad2fe tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:48.069263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9729d486-f036-4d13-9080-12d9bd1ad2fe tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:48.070033 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9729d486-f036-4d13-9080-12d9bd1ad2fe tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:48.070471 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9729d486-f036-4d13-9080-12d9bd1ad2fe tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:48.070644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:48.072005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:48.077949 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:48.078399 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:48.079167 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:48.079599 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:48.268715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9729d486-f036-4d13-9080-12d9bd1ad2fe tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:48.275280 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:48.275999 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9729d486-f036-4d13-9080-12d9bd1ad2fe tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.218266 Mar 30 07:17:48.276545 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 148/299] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:48 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:48.283533 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:48.285276 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:48.286430 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a3a57f77-ca6c-429b-baa4-7633588d0f2c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.219670 Mar 30 07:17:48.286976 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 152/300] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:48 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:48.911415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-add6bc30-cd88-4f68-ad23-359f23249bcc tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:48.912259 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-add6bc30-cd88-4f68-ad23-359f23249bcc tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:48.915310 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-104e027d-9309-4a2e-81d6-081666a21f6d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:48.916057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-104e027d-9309-4a2e-81d6-081666a21f6d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:48.921360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-add6bc30-cd88-4f68-ad23-359f23249bcc tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:48.921866 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-add6bc30-cd88-4f68-ad23-359f23249bcc tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:48.922787 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-add6bc30-cd88-4f68-ad23-359f23249bcc tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:48.923285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-add6bc30-cd88-4f68-ad23-359f23249bcc tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:48.924100 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-104e027d-9309-4a2e-81d6-081666a21f6d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:48.924643 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-104e027d-9309-4a2e-81d6-081666a21f6d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:48.925587 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-104e027d-9309-4a2e-81d6-081666a21f6d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:48.926086 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-104e027d-9309-4a2e-81d6-081666a21f6d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.122972 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-add6bc30-cd88-4f68-ad23-359f23249bcc tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:49.129934 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-104e027d-9309-4a2e-81d6-081666a21f6d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:49.137043 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-add6bc30-cd88-4f68-ad23-359f23249bcc tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1313 microversion: 2.1 time: 0.231269 Mar 30 07:17:49.138229 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 149/301] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:48 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:49.138386 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-104e027d-9309-4a2e-81d6-081666a21f6d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.227798 Mar 30 07:17:49.138935 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 153/302] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:48 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:49.302815 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-01b8b868-1501-4082-9dfe-a7d91f99ee78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:49.302815 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-01b8b868-1501-4082-9dfe-a7d91f99ee78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:49.302815 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-01b8b868-1501-4082-9dfe-a7d91f99ee78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.303211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-01b8b868-1501-4082-9dfe-a7d91f99ee78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.304008 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-01b8b868-1501-4082-9dfe-a7d91f99ee78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.304426 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-01b8b868-1501-4082-9dfe-a7d91f99ee78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.309523 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:49.310141 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:49.316349 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.316820 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.317663 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.318051 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.502372 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-01b8b868-1501-4082-9dfe-a7d91f99ee78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:49.510422 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-01b8b868-1501-4082-9dfe-a7d91f99ee78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1503 microversion: 2.1 time: 0.218151 Mar 30 07:17:49.515995 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 150/303] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:49 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:49.526409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:49.527888 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "017927d2-fa51-4b1e-a7ff-4374383bfe64"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:49.529023 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:49.534602 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:49.535515 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.535910 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.536143 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:49.536661 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.537087 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.537295 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ba492d95-1da5-4023-b68a-6cdaac818338 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.231736 Mar 30 07:17:49.537837 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 154/304] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:49 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:17:49.560633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] HTTP exception thrown: Cannot 'attach_volume' instance 7fedaffa-1632-4376-a01c-64b81265770e while it is in vm_state rescued Mar 30 07:17:49.561212 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Returning 409 to user: Cannot 'attach_volume' instance 7fedaffa-1632-4376-a01c-64b81265770e while it is in vm_state rescued {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:17:49.562035 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-03292b45-c0d6-4772-b81c-ab5937ee2c7a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038872 Mar 30 07:17:49.562582 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 151/305] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:17:49 2022] POST /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 30 07:17:49.571551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6f06ae71-2300-4382-918d-8bab77ffca8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:49.572124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6f06ae71-2300-4382-918d-8bab77ffca8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:49.578276 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f06ae71-2300-4382-918d-8bab77ffca8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.578740 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f06ae71-2300-4382-918d-8bab77ffca8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.579508 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f06ae71-2300-4382-918d-8bab77ffca8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.580147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f06ae71-2300-4382-918d-8bab77ffca8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.646367 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6f06ae71-2300-4382-918d-8bab77ffca8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e/action" status: 202 len: 0 microversion: 2.1 time: 0.078516 Mar 30 07:17:49.647948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 155/306] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:17:49 2022] POST /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:17:49.655587 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-30216493-e21e-4689-9398-4b3da6e586e4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:49.656235 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-30216493-e21e-4689-9398-4b3da6e586e4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:49.663034 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30216493-e21e-4689-9398-4b3da6e586e4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.663594 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30216493-e21e-4689-9398-4b3da6e586e4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.664385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30216493-e21e-4689-9398-4b3da6e586e4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:49.664820 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30216493-e21e-4689-9398-4b3da6e586e4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:49.803938 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-30216493-e21e-4689-9398-4b3da6e586e4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:49.812322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-30216493-e21e-4689-9398-4b3da6e586e4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1511 microversion: 2.1 time: 0.160577 Mar 30 07:17:49.812824 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 152/307] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:49 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:50.158765 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b44cc142-1d6f-43ef-a492-c51b0b051436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:50.159528 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0f818680-29d2-469c-be26-414b6f89b8e5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:50.159917 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b44cc142-1d6f-43ef-a492-c51b0b051436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:50.160030 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0f818680-29d2-469c-be26-414b6f89b8e5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:50.166387 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b44cc142-1d6f-43ef-a492-c51b0b051436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:50.166573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0f818680-29d2-469c-be26-414b6f89b8e5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:50.166833 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b44cc142-1d6f-43ef-a492-c51b0b051436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:50.167028 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0f818680-29d2-469c-be26-414b6f89b8e5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:50.167569 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b44cc142-1d6f-43ef-a492-c51b0b051436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:50.167779 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0f818680-29d2-469c-be26-414b6f89b8e5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:50.168065 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b44cc142-1d6f-43ef-a492-c51b0b051436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:50.168217 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0f818680-29d2-469c-be26-414b6f89b8e5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:50.370731 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0f818680-29d2-469c-be26-414b6f89b8e5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:50.374069 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b44cc142-1d6f-43ef-a492-c51b0b051436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:50.379105 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0f818680-29d2-469c-be26-414b6f89b8e5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.226141 Mar 30 07:17:50.379672 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 153/308] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:50 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:50.384011 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b44cc142-1d6f-43ef-a492-c51b0b051436 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1496 microversion: 2.1 time: 0.232350 Mar 30 07:17:50.384719 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 156/309] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:50 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1496 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:50.559875 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:50.560904 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:50.571480 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:50.572278 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:50.573539 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:50.574257 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:50.724911 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:50.737289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:50.738798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:50.740073 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-40182ad3-29ab-4ed1-b718-648227520b4c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.186682 Mar 30 07:17:50.740637 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 154/310] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:50 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:50.838422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-70ece495-1982-455d-a688-c4e1d2705bb1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:50.839433 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-70ece495-1982-455d-a688-c4e1d2705bb1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:50.848706 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-70ece495-1982-455d-a688-c4e1d2705bb1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:50.849160 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-70ece495-1982-455d-a688-c4e1d2705bb1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:50.849928 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-70ece495-1982-455d-a688-c4e1d2705bb1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:50.850362 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-70ece495-1982-455d-a688-c4e1d2705bb1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:51.001626 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-70ece495-1982-455d-a688-c4e1d2705bb1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:51.010210 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-70ece495-1982-455d-a688-c4e1d2705bb1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1511 microversion: 2.1 time: 0.178176 Mar 30 07:17:51.010777 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 157/311] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:50 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:51.397033 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-24f1fe34-9b55-4c07-b509-dbca8c79676e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:51.398181 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-24f1fe34-9b55-4c07-b509-dbca8c79676e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:51.404951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-24f1fe34-9b55-4c07-b509-dbca8c79676e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:51.405400 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-24f1fe34-9b55-4c07-b509-dbca8c79676e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:51.406165 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-24f1fe34-9b55-4c07-b509-dbca8c79676e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:51.406597 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-24f1fe34-9b55-4c07-b509-dbca8c79676e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:51.557733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-24f1fe34-9b55-4c07-b509-dbca8c79676e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:51.565775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-24f1fe34-9b55-4c07-b509-dbca8c79676e tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.172980 Mar 30 07:17:51.566317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 155/312] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:51 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:51.761343 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:51.762162 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:51.771766 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:51.772442 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:51.773521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:51.774128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:51.924849 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:51.933122 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:51.934621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:51.935781 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-72960572-0c03-43dc-9b01-87c79d158337 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.180020 Mar 30 07:17:51.936368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 158/313] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:51 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:52.031686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c7b48748-dcfa-4e01-991f-71b387791b32 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:52.032693 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c7b48748-dcfa-4e01-991f-71b387791b32 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:52.043236 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c7b48748-dcfa-4e01-991f-71b387791b32 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:52.044061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c7b48748-dcfa-4e01-991f-71b387791b32 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:52.045324 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c7b48748-dcfa-4e01-991f-71b387791b32 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:52.046048 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c7b48748-dcfa-4e01-991f-71b387791b32 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:52.184499 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c7b48748-dcfa-4e01-991f-71b387791b32 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:52.193289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c7b48748-dcfa-4e01-991f-71b387791b32 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1511 microversion: 2.1 time: 0.168011 Mar 30 07:17:52.193885 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 156/314] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:52 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:52.582760 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fb89e686-2753-4743-af06-25095d04d551 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:52.583433 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fb89e686-2753-4743-af06-25095d04d551 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:52.589172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb89e686-2753-4743-af06-25095d04d551 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:52.589647 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb89e686-2753-4743-af06-25095d04d551 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:52.590410 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb89e686-2753-4743-af06-25095d04d551 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:52.590840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb89e686-2753-4743-af06-25095d04d551 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:52.727573 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fb89e686-2753-4743-af06-25095d04d551 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:52.736262 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fb89e686-2753-4743-af06-25095d04d551 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1725 microversion: 2.1 time: 0.157466 Mar 30 07:17:52.737437 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 159/315] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:52 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:52.957432 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:52.957992 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:52.964921 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:52.965441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:52.966299 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:52.966733 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.098253 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4045c5e4-02af-4ecc-99ff-9215f12c9ad8 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:53.099591 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4045c5e4-02af-4ecc-99ff-9215f12c9ad8 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:53.111588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4045c5e4-02af-4ecc-99ff-9215f12c9ad8 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.113842 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4045c5e4-02af-4ecc-99ff-9215f12c9ad8 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.114840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4045c5e4-02af-4ecc-99ff-9215f12c9ad8 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.115247 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4045c5e4-02af-4ecc-99ff-9215f12c9ad8 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.141982 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4045c5e4-02af-4ecc-99ff-9215f12c9ad8 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:17:53.142155 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:53.151647 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:53.153230 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:53.154784 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-93ba09de-c467-4c85-989c-0cbff3d248e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.204102 Mar 30 07:17:53.155241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 157/316] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:52 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:53.212127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-581e3692-f9a9-4e0e-a701-0099928117d9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:53.213044 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-581e3692-f9a9-4e0e-a701-0099928117d9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:53.219326 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-581e3692-f9a9-4e0e-a701-0099928117d9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.219864 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-581e3692-f9a9-4e0e-a701-0099928117d9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.220573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-581e3692-f9a9-4e0e-a701-0099928117d9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.221189 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-581e3692-f9a9-4e0e-a701-0099928117d9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.227142 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4045c5e4-02af-4ecc-99ff-9215f12c9ad8 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 204 len: 0 microversion: 2.1 time: 0.132457 Mar 30 07:17:53.228469 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 160/317] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:17:53 2022] DELETE /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:17:53.237205 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3283bfb2-f4fe-460d-9e7f-f6698d30fa7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:53.238011 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3283bfb2-f4fe-460d-9e7f-f6698d30fa7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:53.243719 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3283bfb2-f4fe-460d-9e7f-f6698d30fa7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.244195 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3283bfb2-f4fe-460d-9e7f-f6698d30fa7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.245536 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3283bfb2-f4fe-460d-9e7f-f6698d30fa7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.246135 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3283bfb2-f4fe-460d-9e7f-f6698d30fa7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.426943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-581e3692-f9a9-4e0e-a701-0099928117d9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:53.434547 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3283bfb2-f4fe-460d-9e7f-f6698d30fa7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:53.436390 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-581e3692-f9a9-4e0e-a701-0099928117d9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1511 microversion: 2.1 time: 0.229294 Mar 30 07:17:53.437154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 158/318] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:53 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:53.442232 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3283bfb2-f4fe-460d-9e7f-f6698d30fa7d tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1502 microversion: 2.1 time: 0.209115 Mar 30 07:17:53.443004 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 161/319] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:53 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:53.755127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-74af30d3-c42a-4d21-a1e3-e6f38821310b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:53.755726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-74af30d3-c42a-4d21-a1e3-e6f38821310b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:53.761934 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-74af30d3-c42a-4d21-a1e3-e6f38821310b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.762387 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-74af30d3-c42a-4d21-a1e3-e6f38821310b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.763152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-74af30d3-c42a-4d21-a1e3-e6f38821310b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.763590 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-74af30d3-c42a-4d21-a1e3-e6f38821310b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:53.916161 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-74af30d3-c42a-4d21-a1e3-e6f38821310b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:53.924186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-74af30d3-c42a-4d21-a1e3-e6f38821310b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1702 microversion: 2.1 time: 0.173247 Mar 30 07:17:53.924895 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 159/320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:53 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1702 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:53.941704 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1145c7eb-5f97-414d-af12-36057c3e1edb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:53.947657 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1145c7eb-5f97-414d-af12-36057c3e1edb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:53.948147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1145c7eb-5f97-414d-af12-36057c3e1edb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.008374 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1145c7eb-5f97-414d-af12-36057c3e1edb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Going to try to start instance {{(pid=117062) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 30 07:17:54.051795 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1145c7eb-5f97-414d-af12-36057c3e1edb tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/action" status: 202 len: 0 microversion: 2.1 time: 0.113760 Mar 30 07:17:54.052727 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 162/321] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:17:53 2022] POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 30 07:17:54.063705 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-29979afc-437b-4cd7-ac11-67750f7cd013 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:54.064803 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-29979afc-437b-4cd7-ac11-67750f7cd013 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:54.071628 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-29979afc-437b-4cd7-ac11-67750f7cd013 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:54.072102 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-29979afc-437b-4cd7-ac11-67750f7cd013 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.072860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-29979afc-437b-4cd7-ac11-67750f7cd013 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:54.073264 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-29979afc-437b-4cd7-ac11-67750f7cd013 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.174014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:54.174790 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:54.181363 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:54.181805 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.182612 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:54.183039 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.224127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-29979afc-437b-4cd7-ac11-67750f7cd013 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:54.232822 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-29979afc-437b-4cd7-ac11-67750f7cd013 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1711 microversion: 2.1 time: 0.175269 Mar 30 07:17:54.233412 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 160/322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:54 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1711 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:54.328212 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:54.336206 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:54.337706 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:54.338857 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-cec56cbe-d499-4fc5-9a3f-e968c789bb4d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.169142 Mar 30 07:17:54.339423 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 163/323] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:54 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:17:54.456773 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ef42dad2-fad4-420d-b598-c895add0d00f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:54.457386 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ef42dad2-fad4-420d-b598-c895add0d00f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:54.460383 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a6274c4b-b5e2-4b5f-bba3-f71ead8eadbe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:54.460992 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a6274c4b-b5e2-4b5f-bba3-f71ead8eadbe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:54.463983 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ef42dad2-fad4-420d-b598-c895add0d00f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:54.464434 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ef42dad2-fad4-420d-b598-c895add0d00f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.465208 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ef42dad2-fad4-420d-b598-c895add0d00f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:54.465641 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ef42dad2-fad4-420d-b598-c895add0d00f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.467117 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a6274c4b-b5e2-4b5f-bba3-f71ead8eadbe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:54.467572 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a6274c4b-b5e2-4b5f-bba3-f71ead8eadbe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.468352 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a6274c4b-b5e2-4b5f-bba3-f71ead8eadbe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:54.468779 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a6274c4b-b5e2-4b5f-bba3-f71ead8eadbe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:54.663863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ef42dad2-fad4-420d-b598-c895add0d00f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:54.667335 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a6274c4b-b5e2-4b5f-bba3-f71ead8eadbe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:54.672301 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ef42dad2-fad4-420d-b598-c895add0d00f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1511 microversion: 2.1 time: 0.221201 Mar 30 07:17:54.673071 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 161/324] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:54 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:54.675911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a6274c4b-b5e2-4b5f-bba3-f71ead8eadbe tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1502 microversion: 2.1 time: 0.219563 Mar 30 07:17:54.676854 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 164/325] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:54 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:55.251563 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7f0f269f-3167-42d3-9550-da2bac0ea908 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:55.252238 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7f0f269f-3167-42d3-9550-da2bac0ea908 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:55.259180 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7f0f269f-3167-42d3-9550-da2bac0ea908 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:55.259637 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7f0f269f-3167-42d3-9550-da2bac0ea908 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:55.260436 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7f0f269f-3167-42d3-9550-da2bac0ea908 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:55.260871 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7f0f269f-3167-42d3-9550-da2bac0ea908 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:55.357699 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:55.358344 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:55.364907 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:55.365351 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:55.366121 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:55.366549 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:55.411017 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7f0f269f-3167-42d3-9550-da2bac0ea908 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:55.419086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7f0f269f-3167-42d3-9550-da2bac0ea908 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1711 microversion: 2.1 time: 0.171458 Mar 30 07:17:55.419685 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 162/326] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:55 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1711 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:55.514240 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:55.522683 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:55.524263 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:55.525493 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a081bbe3-961d-41e7-b8c5-9e854212040d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.172111 Mar 30 07:17:55.526037 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 165/327] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:55 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:17:55.689916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f8bbdfd5-e40e-4ade-bab9-86d4bedbb9a9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:55.690518 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f8bbdfd5-e40e-4ade-bab9-86d4bedbb9a9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:55.693660 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-098a676a-96bc-4f8d-918d-e34a64841309 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:55.694177 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-098a676a-96bc-4f8d-918d-e34a64841309 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:55.697439 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f8bbdfd5-e40e-4ade-bab9-86d4bedbb9a9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:55.697913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f8bbdfd5-e40e-4ade-bab9-86d4bedbb9a9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:55.698648 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f8bbdfd5-e40e-4ade-bab9-86d4bedbb9a9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:55.699103 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f8bbdfd5-e40e-4ade-bab9-86d4bedbb9a9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:55.699990 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-098a676a-96bc-4f8d-918d-e34a64841309 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:55.700448 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-098a676a-96bc-4f8d-918d-e34a64841309 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:55.701217 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-098a676a-96bc-4f8d-918d-e34a64841309 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:55.701650 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-098a676a-96bc-4f8d-918d-e34a64841309 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:55.895028 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f8bbdfd5-e40e-4ade-bab9-86d4bedbb9a9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:55.898087 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-098a676a-96bc-4f8d-918d-e34a64841309 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:55.902770 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f8bbdfd5-e40e-4ade-bab9-86d4bedbb9a9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1511 microversion: 2.1 time: 0.216710 Mar 30 07:17:55.903542 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 163/328] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:55 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:55.906027 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-098a676a-96bc-4f8d-918d-e34a64841309 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1502 microversion: 2.1 time: 0.216275 Mar 30 07:17:55.906575 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 166/329] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:55 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:56.439872 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2c7c4576-bf6e-4094-ac72-7b76d0e4f9d9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:56.440629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2c7c4576-bf6e-4094-ac72-7b76d0e4f9d9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:56.449889 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c7c4576-bf6e-4094-ac72-7b76d0e4f9d9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:56.450547 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c7c4576-bf6e-4094-ac72-7b76d0e4f9d9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:56.451690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c7c4576-bf6e-4094-ac72-7b76d0e4f9d9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:56.452158 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c7c4576-bf6e-4094-ac72-7b76d0e4f9d9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:56.543969 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:56.544760 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:56.563423 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:56.563889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:56.564659 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:56.565087 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:56.602194 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2c7c4576-bf6e-4094-ac72-7b76d0e4f9d9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:56.618731 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2c7c4576-bf6e-4094-ac72-7b76d0e4f9d9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1711 microversion: 2.1 time: 0.184453 Mar 30 07:17:56.619713 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 164/330] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:56 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1711 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:56.756247 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:56.764994 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:56.766476 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:56.767834 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-74003ae7-3d6d-403e-8008-467af3e00d3a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.227798 Mar 30 07:17:56.769358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 167/331] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:56 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:17:56.922930 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0edbf587-0ac1-4c73-9b55-29850a40e22b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:56.923177 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-803ba371-7264-4f4c-977b-9b298d21d1b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:56.923539 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0edbf587-0ac1-4c73-9b55-29850a40e22b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:56.923994 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-803ba371-7264-4f4c-977b-9b298d21d1b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:56.930987 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-803ba371-7264-4f4c-977b-9b298d21d1b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:56.931396 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0edbf587-0ac1-4c73-9b55-29850a40e22b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:56.931862 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0edbf587-0ac1-4c73-9b55-29850a40e22b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:56.932019 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-803ba371-7264-4f4c-977b-9b298d21d1b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:56.933092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-803ba371-7264-4f4c-977b-9b298d21d1b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:56.933224 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0edbf587-0ac1-4c73-9b55-29850a40e22b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:56.933615 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0edbf587-0ac1-4c73-9b55-29850a40e22b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:56.933752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-803ba371-7264-4f4c-977b-9b298d21d1b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:57.225986 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0edbf587-0ac1-4c73-9b55-29850a40e22b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:57.234508 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0edbf587-0ac1-4c73-9b55-29850a40e22b tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1502 microversion: 2.1 time: 0.315599 Mar 30 07:17:57.235637 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 168/332] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:56 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1502 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:17:57.245287 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-803ba371-7264-4f4c-977b-9b298d21d1b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:57.253283 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-803ba371-7264-4f4c-977b-9b298d21d1b0 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1511 microversion: 2.1 time: 0.337418 Mar 30 07:17:57.254296 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 165/333] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:56 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:57.641950 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-376c8baa-0c28-4dce-829c-51d593685a23 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:57.643511 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-376c8baa-0c28-4dce-829c-51d593685a23 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:57.653916 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-376c8baa-0c28-4dce-829c-51d593685a23 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:57.654690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-376c8baa-0c28-4dce-829c-51d593685a23 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:57.656045 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-376c8baa-0c28-4dce-829c-51d593685a23 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:57.656761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-376c8baa-0c28-4dce-829c-51d593685a23 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:57.787237 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:57.788086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:57.794622 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:57.795169 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:57.796155 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:57.796457 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:57.817704 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-376c8baa-0c28-4dce-829c-51d593685a23 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:57.827169 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-376c8baa-0c28-4dce-829c-51d593685a23 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1711 microversion: 2.1 time: 0.192962 Mar 30 07:17:57.827751 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 169/334] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:57 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1711 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:57.833643 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-9a363abf-2044-465e-b073-1c3369f47e72 req-aa800bc2-c941-47ee-b12d-586df2edf754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977a73f-876d-4d10-adf8-326ed77fc467", "name": "network-vif-plugged", "status": "completed", "tag": "46952506-ed7a-47ba-a4d4-3306605e4824"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:57.842638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-9a363abf-2044-465e-b073-1c3369f47e72 req-aa800bc2-c941-47ee-b12d-586df2edf754 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:57.843079 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-9a363abf-2044-465e-b073-1c3369f47e72 req-aa800bc2-c941-47ee-b12d-586df2edf754 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:57.856213 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-9a363abf-2044-465e-b073-1c3369f47e72 req-aa800bc2-c941-47ee-b12d-586df2edf754 service nova] Creating event network-vif-plugged:46952506-ed7a-47ba-a4d4-3306605e4824 for instance d977a73f-876d-4d10-adf8-326ed77fc467 on hv-cinder-83577 Mar 30 07:17:57.861108 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-9a363abf-2044-465e-b073-1c3369f47e72 req-aa800bc2-c941-47ee-b12d-586df2edf754 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Mar 30 07:17:57.861712 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 170/335] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:17:57.943398 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:57.951324 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:57.952890 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:57.954054 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cfc105d7-eb00-4ead-92c4-2376bfba8c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1744 microversion: 2.20 time: 0.171781 Mar 30 07:17:57.954580 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 166/336] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:57 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:17:58.253745 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1f79d6e6-2fa2-40fc-9a2b-1cc7bdd10575 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:58.254447 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1f79d6e6-2fa2-40fc-9a2b-1cc7bdd10575 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:58.262818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1f79d6e6-2fa2-40fc-9a2b-1cc7bdd10575 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:58.263370 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1f79d6e6-2fa2-40fc-9a2b-1cc7bdd10575 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:58.264208 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1f79d6e6-2fa2-40fc-9a2b-1cc7bdd10575 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:58.264638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1f79d6e6-2fa2-40fc-9a2b-1cc7bdd10575 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:58.270514 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-daf1c49b-5839-43a2-a961-b1fe12637608 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:58.271204 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-daf1c49b-5839-43a2-a961-b1fe12637608 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:58.277506 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-daf1c49b-5839-43a2-a961-b1fe12637608 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:58.277943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-daf1c49b-5839-43a2-a961-b1fe12637608 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:58.278720 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-daf1c49b-5839-43a2-a961-b1fe12637608 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:58.279146 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-daf1c49b-5839-43a2-a961-b1fe12637608 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:58.463911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1f79d6e6-2fa2-40fc-9a2b-1cc7bdd10575 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:58.471876 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1f79d6e6-2fa2-40fc-9a2b-1cc7bdd10575 tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1502 microversion: 2.1 time: 0.222811 Mar 30 07:17:58.473721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 171/337] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:58 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1502 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:58.476896 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-daf1c49b-5839-43a2-a961-b1fe12637608 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:58.485015 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-daf1c49b-5839-43a2-a961-b1fe12637608 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1511 microversion: 2.1 time: 0.218338 Mar 30 07:17:58.485603 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 167/338] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:58 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:58.845021 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f486ba65-3308-4d5d-89ba-04441e56ad51 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:58.845622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f486ba65-3308-4d5d-89ba-04441e56ad51 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:58.851995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f486ba65-3308-4d5d-89ba-04441e56ad51 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:58.852688 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f486ba65-3308-4d5d-89ba-04441e56ad51 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:58.853684 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f486ba65-3308-4d5d-89ba-04441e56ad51 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:58.854311 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f486ba65-3308-4d5d-89ba-04441e56ad51 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:58.972752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:58.973367 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:58.984714 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:58.985388 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:58.986357 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:58.986812 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:59.013992 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f486ba65-3308-4d5d-89ba-04441e56ad51 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:59.022188 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f486ba65-3308-4d5d-89ba-04441e56ad51 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1715 microversion: 2.1 time: 0.181158 Mar 30 07:17:59.022762 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 172/339] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:58 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1715 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:59.043332 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-972d6601-056f-4f7f-8f14-741db71e308b req-ab0cd096-6cf2-48a5-8f61-a3b7ea20dfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a18d09-8837-41b4-86c1-5cf12a63233c", "name": "network-vif-deleted", "tag": "b5568592-f745-4f0c-9973-1c35f4a53778"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:17:59.051495 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-972d6601-056f-4f7f-8f14-741db71e308b req-ab0cd096-6cf2-48a5-8f61-a3b7ea20dfa2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:59.051957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-972d6601-056f-4f7f-8f14-741db71e308b req-ab0cd096-6cf2-48a5-8f61-a3b7ea20dfa2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:59.063281 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-972d6601-056f-4f7f-8f14-741db71e308b req-ab0cd096-6cf2-48a5-8f61-a3b7ea20dfa2 service nova] Creating event network-vif-deleted:b5568592-f745-4f0c-9973-1c35f4a53778 for instance f8a18d09-8837-41b4-86c1-5cf12a63233c on hv-cinder-83577 Mar 30 07:17:59.068534 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-972d6601-056f-4f7f-8f14-741db71e308b req-ab0cd096-6cf2-48a5-8f61-a3b7ea20dfa2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028612 Mar 30 07:17:59.069138 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 173/340] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:17:59.180695 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:59.189226 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:59.190715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:59.192844 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-18fbf052-e1ef-40a0-b4a0-f0ea4ff50f87 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1744 microversion: 2.20 time: 0.224056 Mar 30 07:17:59.193472 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 168/341] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:17:58 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:17:59.492111 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:59.492799 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:59.499611 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:59.500112 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:59.500906 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:59.501339 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:59.501951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d85c79c1-24ad-4a37-a0a2-54325df46423 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:17:59.502556 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d85c79c1-24ad-4a37-a0a2-54325df46423 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:17:59.509052 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d85c79c1-24ad-4a37-a0a2-54325df46423 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:59.509510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d85c79c1-24ad-4a37-a0a2-54325df46423 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:59.510260 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d85c79c1-24ad-4a37-a0a2-54325df46423 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:59.510685 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d85c79c1-24ad-4a37-a0a2-54325df46423 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:59.535156 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:17:59.535703 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:17:59.536261 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lazy-loading 'fault' on Instance uuid f8a18d09-8837-41b4-86c1-5cf12a63233c {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:17:59.596153 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23be35231cd6493e917259e81b849c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad5fa9994340d78e5489bc40885480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:59.604892 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-824f3aee-7c05-4eff-9c94-e92fb978182c tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 200 len: 1303 microversion: 2.1 time: 0.117846 Mar 30 07:17:59.605871 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 174/342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:59 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:17:59.672123 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d85c79c1-24ad-4a37-a0a2-54325df46423 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:17:59.680768 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d85c79c1-24ad-4a37-a0a2-54325df46423 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1517 microversion: 2.1 time: 0.182444 Mar 30 07:17:59.681334 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 169/343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:17:59 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:00.212568 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:00.213852 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:00.220983 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:00.221584 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:00.222405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:00.222974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:00.362545 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:00.370994 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:00.372663 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:00.373867 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2197325b-af64-49f8-97fe-c23cbd353073 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.166024 Mar 30 07:18:00.374467 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 175/344] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:00 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:00.623715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:00.624529 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] [instance: f8a18d09-8837-41b4-86c1-5cf12a63233c] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:00.632364 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:00.633126 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:00.634101 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:00.634948 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:00.651660 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] HTTP exception thrown: Instance f8a18d09-8837-41b4-86c1-5cf12a63233c could not be found. Mar 30 07:18:00.652289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] Returning 404 to user: Instance f8a18d09-8837-41b4-86c1-5cf12a63233c could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:18:00.653105 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-faaf00ea-c40d-4683-96fd-610f2fce7a3e tempest-VolumesActionsTest-1516324489 tempest-VolumesActionsTest-1516324489-project] 10.222.0.20 "GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c" status: 404 len: 111 microversion: 2.1 time: 0.033997 Mar 30 07:18:00.653662 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 170/345] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:00 2022] GET /compute/v2.1/servers/f8a18d09-8837-41b4-86c1-5cf12a63233c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:18:01.145265 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-121c553c-5b67-405b-8d20-b49959efb5e1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:01.145761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-121c553c-5b67-405b-8d20-b49959efb5e1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:01.157074 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-121c553c-5b67-405b-8d20-b49959efb5e1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:01.157822 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-121c553c-5b67-405b-8d20-b49959efb5e1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:01.158861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-121c553c-5b67-405b-8d20-b49959efb5e1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:01.160708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-121c553c-5b67-405b-8d20-b49959efb5e1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:01.250642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-20d6ecea-bff1-45aa-a426-db524b5ea2a8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'create', calling method: .version_select at 0x7f154c2003a0>, body: {"keypair": {"name": "tempest-keypair-1418839186"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:01.268588 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-20d6ecea-bff1-45aa-a426-db524b5ea2a8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for project b5ef95aec46649a2b057416827ea46aa. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:18:01.274711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-20d6ecea-bff1-45aa-a426-db524b5ea2a8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for user bc84d32966d34ff29620cd40d3d9cc3a and project b5ef95aec46649a2b057416827ea46aa. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:18:01.419687 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-121c553c-5b67-405b-8d20-b49959efb5e1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lazy-loading 'services' on Instance uuid 13f5b104-2044-42c1-9fc9-af2d203240cf {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:18:01.569070 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-121c553c-5b67-405b-8d20-b49959efb5e1 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "DELETE /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf/os-volume_attachments/13e67636-b806-4734-82a7-cd5057c77f46" status: 202 len: 0 microversion: 2.1 time: 0.427323 Mar 30 07:18:01.574037 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 176/346] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:18:01 2022] DELETE /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf/os-volume_attachments/13e67636-b806-4734-82a7-cd5057c77f46 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:18:01.587940 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:01.588895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:01.600159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:01.601011 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:01.602209 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:01.602944 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:01.789413 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:01.797586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-20d6ecea-bff1-45aa-a426-db524b5ea2a8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for project b5ef95aec46649a2b057416827ea46aa. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:18:01.799488 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:01.801367 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:01.802532 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-20d6ecea-bff1-45aa-a426-db524b5ea2a8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for user bc84d32966d34ff29620cd40d3d9cc3a and project b5ef95aec46649a2b057416827ea46aa. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:18:01.802974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f0e4f316-4851-4b0f-ad90-158f612a2350 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.226312 Mar 30 07:18:01.804089 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 177/347] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:01 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:01.827763 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-20d6ecea-bff1-45aa-a426-db524b5ea2a8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.582590 Mar 30 07:18:01.829114 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 171/348] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:18:01 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:02.821470 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:02.822071 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:02.840715 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:02.841336 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:02.844196 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:02.844636 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:02.949230 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2fc66be7-a11c-422d-9e53-7d5bb29ba89f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:02.951020 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2fc66be7-a11c-422d-9e53-7d5bb29ba89f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:02.960344 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2fc66be7-a11c-422d-9e53-7d5bb29ba89f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:02.961111 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2fc66be7-a11c-422d-9e53-7d5bb29ba89f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:02.962709 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2fc66be7-a11c-422d-9e53-7d5bb29ba89f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:02.963382 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2fc66be7-a11c-422d-9e53-7d5bb29ba89f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:02.992382 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2fc66be7-a11c-422d-9e53-7d5bb29ba89f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:18:03.102061 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:03.111366 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:03.114718 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:03.116166 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3531cb02-3ce7-4626-83cd-904d3f4cdecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.298527 Mar 30 07:18:03.127936 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 178/349] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:02 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:18:03.152634 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2fc66be7-a11c-422d-9e53-7d5bb29ba89f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "DELETE /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 204 len: 0 microversion: 2.1 time: 0.207113 Mar 30 07:18:03.162394 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d368b0a7-945b-4031-bb96-14421a7b8ac4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:03.163014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d368b0a7-945b-4031-bb96-14421a7b8ac4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:03.164644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 172/350] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:18:02 2022] DELETE /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 30 07:18:03.169013 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d368b0a7-945b-4031-bb96-14421a7b8ac4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:03.169456 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d368b0a7-945b-4031-bb96-14421a7b8ac4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:03.170690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d368b0a7-945b-4031-bb96-14421a7b8ac4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:03.171273 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d368b0a7-945b-4031-bb96-14421a7b8ac4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:03.358843 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d368b0a7-945b-4031-bb96-14421a7b8ac4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:03.374662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d368b0a7-945b-4031-bb96-14421a7b8ac4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1514 microversion: 2.1 time: 0.216485 Mar 30 07:18:03.381804 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 179/351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:03 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:03.516820 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-370230064", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9678c55-7461-4938-ba80-6574cdde20b1"}], "security_groups": [{"name": "tempest-securitygroup--639520915"}], "key_name": "tempest-keypair-1418839186", "user_data": "}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:04.134915 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:04.136272 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:04.149433 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:04.149970 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:04.150990 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:04.151613 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:04.309455 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:04.318687 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:04.320483 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:04.321797 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9cf2edcc-2129-44b0-b924-6fe28f6f258d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.190909 Mar 30 07:18:04.322462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 180/352] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:04 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:04.393178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-80879f8b-90ea-4046-ba0a-f5f8e0a526d3 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:04.394317 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-80879f8b-90ea-4046-ba0a-f5f8e0a526d3 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:04.402501 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-80879f8b-90ea-4046-ba0a-f5f8e0a526d3 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:04.403114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-80879f8b-90ea-4046-ba0a-f5f8e0a526d3 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:04.404165 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-80879f8b-90ea-4046-ba0a-f5f8e0a526d3 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:04.404668 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-80879f8b-90ea-4046-ba0a-f5f8e0a526d3 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:04.566746 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-80879f8b-90ea-4046-ba0a-f5f8e0a526d3 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:04.575039 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-80879f8b-90ea-4046-ba0a-f5f8e0a526d3 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1514 microversion: 2.1 time: 0.185832 Mar 30 07:18:04.575693 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 181/353] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:04 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:05.340682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:05.341468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:05.349190 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:05.349838 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:05.350724 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:05.351299 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:05.508272 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:05.516502 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:05.517982 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:05.519253 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9fa3717e-e804-4073-a735-468c099d8508 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.182557 Mar 30 07:18:05.523973 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 182/354] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:05 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:18:05.593410 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-74ab8887-a4f0-4659-9649-fcb628c37724 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:05.594025 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-74ab8887-a4f0-4659-9649-fcb628c37724 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:05.605662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74ab8887-a4f0-4659-9649-fcb628c37724 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:05.605915 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74ab8887-a4f0-4659-9649-fcb628c37724 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:05.609155 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74ab8887-a4f0-4659-9649-fcb628c37724 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:05.609155 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74ab8887-a4f0-4659-9649-fcb628c37724 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:05.758265 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-74ab8887-a4f0-4659-9649-fcb628c37724 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:05.770513 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-74ab8887-a4f0-4659-9649-fcb628c37724 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1514 microversion: 2.1 time: 0.180915 Mar 30 07:18:05.771527 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 183/355] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:05 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:06.195038 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-79933cb1-5562-4021-bc11-584c8ea789cd req-83acc5df-3c32-4b27-9c9c-607060bb84b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f5b104-2044-42c1-9fc9-af2d203240cf", "name": "network-vif-deleted", "tag": "86f18ddd-619f-410a-aacd-20886004ab33"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:06.206292 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-79933cb1-5562-4021-bc11-584c8ea789cd req-83acc5df-3c32-4b27-9c9c-607060bb84b5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:06.206292 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-79933cb1-5562-4021-bc11-584c8ea789cd req-83acc5df-3c32-4b27-9c9c-607060bb84b5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:06.233227 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-79933cb1-5562-4021-bc11-584c8ea789cd req-83acc5df-3c32-4b27-9c9c-607060bb84b5 service nova] Creating event network-vif-deleted:86f18ddd-619f-410a-aacd-20886004ab33 for instance 13f5b104-2044-42c1-9fc9-af2d203240cf on hv-cinder-83577 Mar 30 07:18:06.242652 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-79933cb1-5562-4021-bc11-584c8ea789cd req-83acc5df-3c32-4b27-9c9c-607060bb84b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051392 Mar 30 07:18:06.243915 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 184/356] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:18:06.555895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:06.556574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:06.563701 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:06.564353 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:06.569117 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:06.569117 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:06.787376 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:06.787787 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:06.789371 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:06.790558 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1d46746d-5632-4f2f-aeca-81e1834218b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.249012 Mar 30 07:18:06.791116 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 185/357] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:06 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:06.795671 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:06.796342 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:06.802262 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:06.802729 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:06.804073 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:06.804073 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:06.838091 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:06.838647 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:06.839194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lazy-loading 'fault' on Instance uuid 13f5b104-2044-42c1-9fc9-af2d203240cf {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:18:06.901911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:06.911026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9be4ef1b-cc3d-4730-860e-4ed755e95378 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 200 len: 1309 microversion: 2.1 time: 0.118574 Mar 30 07:18:06.911855 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 186/358] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:06 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:07.809229 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:07.809978 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:07.816734 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:07.817262 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:07.818036 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:07.818472 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:07.966336 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:07.979302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:07.981228 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:07.982438 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-736466e7-4ed3-4be4-880b-ace9e30f3ae8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.177073 Mar 30 07:18:07.983329 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 187/359] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:07 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:07.987896 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:07.988508 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: 13f5b104-2044-42c1-9fc9-af2d203240cf] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:07.994913 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:07.995363 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:07.997957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:07.997957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:08.011194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] HTTP exception thrown: Instance 13f5b104-2044-42c1-9fc9-af2d203240cf could not be found. Mar 30 07:18:08.011839 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Returning 404 to user: Instance 13f5b104-2044-42c1-9fc9-af2d203240cf could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:18:08.013050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5b749b84-eaa4-4f54-b1a3-a1bd794b27c4 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf" status: 404 len: 111 microversion: 2.1 time: 0.028502 Mar 30 07:18:08.013659 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 188/360] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:07 2022] GET /compute/v2.1/servers/13f5b104-2044-42c1-9fc9-af2d203240cf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:18:09.008338 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:09.009786 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:09.017363 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:09.018227 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:09.019422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:09.020114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:09.173330 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:09.183104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:09.184695 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:09.185918 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5b20161a-f05b-4fcc-9fe1-ec3b40b41844 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.188583 Mar 30 07:18:09.191849 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 189/361] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:08 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:09.652836 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] validate_networks() for [('b9678c55-7461-4938-ba80-6574cdde20b1', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:18:10.204173 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:10.205525 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:10.213260 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:10.214118 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:10.215332 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:10.216003 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:10.367944 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:18:10.368380 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:18:10.368877 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:18:10.369282 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:18:10.369691 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:18:10.378687 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:10.379138 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:10.379978 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:10.380431 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:10.397876 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for project b5ef95aec46649a2b057416827ea46aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:18:10.401762 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Getting quotas for user bc84d32966d34ff29620cd40d3d9cc3a and project b5ef95aec46649a2b057416827ea46aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:18:10.412888 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:18:10.415276 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:18:10.423927 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:10.432181 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:10.433689 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:10.434883 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-347fdcb9-f19e-49e6-a99d-bcbd52defefd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.234868 Mar 30 07:18:10.435462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 190/362] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:10 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:10.460874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-36c2088f-f140-4051-a829-83b8cbf584eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.948763 Mar 30 07:18:10.461516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 173/363] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:18:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 6950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:18:10.472244 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5c9cfbeb-2470-4388-9b20-5e8349786069 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:10.472851 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5c9cfbeb-2470-4388-9b20-5e8349786069 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:10.525699 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5c9cfbeb-2470-4388-9b20-5e8349786069 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:10.532257 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5c9cfbeb-2470-4388-9b20-5e8349786069 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1245 microversion: 2.1 time: 0.064665 Mar 30 07:18:10.532819 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 191/364] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:10 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:11.454328 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:11.454954 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:11.461700 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:11.462230 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:11.463024 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:11.463488 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:11.548919 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2dda7ecc-1a45-4c48-acc9-579a18e2ff77 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:11.549583 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2dda7ecc-1a45-4c48-acc9-579a18e2ff77 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:11.557428 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2dda7ecc-1a45-4c48-acc9-579a18e2ff77 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:11.558149 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2dda7ecc-1a45-4c48-acc9-579a18e2ff77 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:11.559108 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2dda7ecc-1a45-4c48-acc9-579a18e2ff77 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:11.559741 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2dda7ecc-1a45-4c48-acc9-579a18e2ff77 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:11.614667 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:11.624230 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:11.626293 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:11.627477 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-475f3295-95b2-472c-a3d5-18f2cc461115 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1739 microversion: 2.20 time: 0.177736 Mar 30 07:18:11.628310 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 174/365] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:11 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:11.630957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2dda7ecc-1a45-4c48-acc9-579a18e2ff77 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:11.638798 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2dda7ecc-1a45-4c48-acc9-579a18e2ff77 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1297 microversion: 2.1 time: 0.093872 Mar 30 07:18:11.639355 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 192/366] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:11 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:12.649520 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:12.650500 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:12.661234 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:12.661818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-64f80637-d6cd-4329-8214-12a091bd9a7b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:12.662946 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:12.663055 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-64f80637-d6cd-4329-8214-12a091bd9a7b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:12.663171 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:12.663468 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:12.668926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-64f80637-d6cd-4329-8214-12a091bd9a7b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:12.669512 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-64f80637-d6cd-4329-8214-12a091bd9a7b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:12.670285 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-64f80637-d6cd-4329-8214-12a091bd9a7b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:12.670712 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-64f80637-d6cd-4329-8214-12a091bd9a7b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:12.744721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-64f80637-d6cd-4329-8214-12a091bd9a7b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:12.752438 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-64f80637-d6cd-4329-8214-12a091bd9a7b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1297 microversion: 2.1 time: 0.097691 Mar 30 07:18:12.752972 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 193/367] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:12 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:12.821376 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:12.829576 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:12.831050 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:12.832223 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-431bbd1e-5257-42f8-a5b4-18bb4c09fba2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1721 microversion: 2.20 time: 0.189421 Mar 30 07:18:12.832777 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 175/368] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:12 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:13.773481 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-25af1268-8d1e-41b5-9381-c893b8fdfc78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:13.774199 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-25af1268-8d1e-41b5-9381-c893b8fdfc78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:13.782509 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-25af1268-8d1e-41b5-9381-c893b8fdfc78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:13.783065 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-25af1268-8d1e-41b5-9381-c893b8fdfc78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:13.784076 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-25af1268-8d1e-41b5-9381-c893b8fdfc78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:13.784617 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-25af1268-8d1e-41b5-9381-c893b8fdfc78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:13.850848 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:13.851309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:13.852781 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-25af1268-8d1e-41b5-9381-c893b8fdfc78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:13.858250 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:13.858711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:13.859477 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:13.859942 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:13.860760 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-25af1268-8d1e-41b5-9381-c893b8fdfc78 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1297 microversion: 2.1 time: 0.093241 Mar 30 07:18:13.861375 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 194/369] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:13 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:13.993588 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:14.001449 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:14.002939 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:14.004100 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ecd9e41b-db0d-4744-8024-d2062b0d79c6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1721 microversion: 2.20 time: 0.157349 Mar 30 07:18:14.004663 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 176/370] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:13 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:14.879888 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2f9841cb-3dc2-4398-af80-ee094b36d22b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:14.880698 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2f9841cb-3dc2-4398-af80-ee094b36d22b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:14.887907 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f9841cb-3dc2-4398-af80-ee094b36d22b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:14.888363 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f9841cb-3dc2-4398-af80-ee094b36d22b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:14.889155 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f9841cb-3dc2-4398-af80-ee094b36d22b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:14.889589 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f9841cb-3dc2-4398-af80-ee094b36d22b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:14.954805 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2f9841cb-3dc2-4398-af80-ee094b36d22b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:14.963590 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2f9841cb-3dc2-4398-af80-ee094b36d22b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1315 microversion: 2.1 time: 0.088266 Mar 30 07:18:14.965860 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 195/371] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:14 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1315 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:15.024864 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:15.025514 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:15.031618 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:15.032108 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:15.032923 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:15.033364 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:15.173895 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:15.182278 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:15.184078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:15.185316 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0176c448-2f76-4e0b-9533-d5eb2e8a89cb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1721 microversion: 2.20 time: 0.164943 Mar 30 07:18:15.186035 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 177/372] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:15 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:15.981264 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fb7376a4-c1a1-48b5-b460-623b06dcb9bc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:15.982523 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fb7376a4-c1a1-48b5-b460-623b06dcb9bc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:15.989911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb7376a4-c1a1-48b5-b460-623b06dcb9bc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:15.990780 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb7376a4-c1a1-48b5-b460-623b06dcb9bc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:15.991720 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb7376a4-c1a1-48b5-b460-623b06dcb9bc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:15.992453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb7376a4-c1a1-48b5-b460-623b06dcb9bc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:16.144251 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fb7376a4-c1a1-48b5-b460-623b06dcb9bc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:16.152714 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fb7376a4-c1a1-48b5-b460-623b06dcb9bc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.175834 Mar 30 07:18:16.153489 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 196/373] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:15 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:16.209395 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:16.210107 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:16.219311 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:16.219848 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:16.225756 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:16.226493 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:16.414557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:16.423642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:16.426481 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:16.428195 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-26c379b1-5065-4794-8b59-0cfe2dc6ace9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1721 microversion: 2.20 time: 0.227912 Mar 30 07:18:16.445148 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 178/374] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:16 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:16.493554 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-c6e20c3b-a513-40db-963f-705db5c041f1 req-f037acd9-a705-45c1-99a8-5b3873ab6627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55662b82-58b5-4206-a411-103fac11b0b2", "tag": "c73621da-1c9c-4d35-9b39-2038b6ae4204"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:16.521239 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-c6e20c3b-a513-40db-963f-705db5c041f1 req-f037acd9-a705-45c1-99a8-5b3873ab6627 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:16.523451 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-c6e20c3b-a513-40db-963f-705db5c041f1 req-f037acd9-a705-45c1-99a8-5b3873ab6627 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:16.537828 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-c6e20c3b-a513-40db-963f-705db5c041f1 req-f037acd9-a705-45c1-99a8-5b3873ab6627 service nova] Creating event network-changed:c73621da-1c9c-4d35-9b39-2038b6ae4204 for instance 55662b82-58b5-4206-a411-103fac11b0b2 on hv-cinder-83577 Mar 30 07:18:16.545254 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-c6e20c3b-a513-40db-963f-705db5c041f1 req-f037acd9-a705-45c1-99a8-5b3873ab6627 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056538 Mar 30 07:18:16.545977 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 197/375] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:18:17.170979 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a2b4e464-c567-448c-bc00-f5f3f9916d4b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:17.171968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a2b4e464-c567-448c-bc00-f5f3f9916d4b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:17.178605 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a2b4e464-c567-448c-bc00-f5f3f9916d4b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:17.179598 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a2b4e464-c567-448c-bc00-f5f3f9916d4b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:17.180674 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a2b4e464-c567-448c-bc00-f5f3f9916d4b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:17.181302 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a2b4e464-c567-448c-bc00-f5f3f9916d4b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:17.339077 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a2b4e464-c567-448c-bc00-f5f3f9916d4b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:17.347007 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a2b4e464-c567-448c-bc00-f5f3f9916d4b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.180280 Mar 30 07:18:17.347924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 179/376] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:17 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:17.453862 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:17.454872 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:17.462589 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:17.463030 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:17.463838 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:17.464301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:17.622092 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:17.630559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:17.632067 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:17.633480 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2ec01692-d3ce-472f-9072-3255518aa08f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1721 microversion: 2.20 time: 0.184026 Mar 30 07:18:17.644340 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 198/377] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:17 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:18.369589 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-355da5f1-aa41-4ac2-88f0-d9ba01f9426e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:18.370526 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-355da5f1-aa41-4ac2-88f0-d9ba01f9426e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:18.379624 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-355da5f1-aa41-4ac2-88f0-d9ba01f9426e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:18.380556 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-355da5f1-aa41-4ac2-88f0-d9ba01f9426e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:18.381876 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-355da5f1-aa41-4ac2-88f0-d9ba01f9426e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:18.382727 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-355da5f1-aa41-4ac2-88f0-d9ba01f9426e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:18.543847 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-355da5f1-aa41-4ac2-88f0-d9ba01f9426e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:18.561573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-355da5f1-aa41-4ac2-88f0-d9ba01f9426e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.196466 Mar 30 07:18:18.575739 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 180/378] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:18 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:18.652923 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:18.654576 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:18.665386 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:18.666405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:18.667725 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:18.668402 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:18.679490 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-b0134b9b-4afc-4274-b9b0-cde74cb9a200 req-5fed2b31-eff5-404e-a43d-12b7e8fd55f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977a73f-876d-4d10-adf8-326ed77fc467", "name": "network-vif-unplugged", "status": "completed", "tag": "46952506-ed7a-47ba-a4d4-3306605e4824"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:18.692814 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-b0134b9b-4afc-4274-b9b0-cde74cb9a200 req-5fed2b31-eff5-404e-a43d-12b7e8fd55f1 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:18.695567 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-b0134b9b-4afc-4274-b9b0-cde74cb9a200 req-5fed2b31-eff5-404e-a43d-12b7e8fd55f1 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:18.716896 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-b0134b9b-4afc-4274-b9b0-cde74cb9a200 req-5fed2b31-eff5-404e-a43d-12b7e8fd55f1 service nova] Creating event network-vif-unplugged:46952506-ed7a-47ba-a4d4-3306605e4824 for instance d977a73f-876d-4d10-adf8-326ed77fc467 on hv-cinder-83577 Mar 30 07:18:18.735678 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-b0134b9b-4afc-4274-b9b0-cde74cb9a200 req-5fed2b31-eff5-404e-a43d-12b7e8fd55f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061798 Mar 30 07:18:18.736632 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 181/379] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:18:18.890215 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:18.899282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:18.900831 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:18.902048 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bfb74463-7451-4da0-89c2-fa637851a007 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1721 microversion: 2.20 time: 0.254299 Mar 30 07:18:18.902793 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 199/380] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:18 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:19.581918 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d0e00261-690c-4dc7-a35a-910c48ec61eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:19.582832 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d0e00261-690c-4dc7-a35a-910c48ec61eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:19.589359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d0e00261-690c-4dc7-a35a-910c48ec61eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:19.590037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d0e00261-690c-4dc7-a35a-910c48ec61eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:19.590874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d0e00261-690c-4dc7-a35a-910c48ec61eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:19.591371 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d0e00261-690c-4dc7-a35a-910c48ec61eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:19.739432 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d0e00261-690c-4dc7-a35a-910c48ec61eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:19.747063 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d0e00261-690c-4dc7-a35a-910c48ec61eb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.170043 Mar 30 07:18:19.747638 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 182/381] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:19 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:19.920158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:19.920818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:19.927122 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:19.927564 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:19.928362 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:19.928787 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:20.080606 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:20.090889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:20.093717 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:20.097826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-79b7866d-4f5e-4518-abaa-bb54d6463997 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1721 microversion: 2.20 time: 0.179398 Mar 30 07:18:20.099734 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 200/382] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:19 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:20.115387 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-653141021", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "networks": [{"uuid": "fc819313-a83f-4db9-a3a8-bf8736f9a577"}]}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:20.188795 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] validate_networks() for [('fc819313-a83f-4db9-a3a8-bf8736f9a577', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:18:20.630256 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:18:20.630845 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:18:20.631128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:18:20.631525 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:18:20.632148 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:18:20.646187 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:20.646889 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:20.647763 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:20.648427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:20.668433 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Getting quotas for project fdbabd5e38b749abb59cbf2680697a54. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:18:20.672448 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Getting quotas for user b25ac073374a491899b09b5c7810eb84 and project fdbabd5e38b749abb59cbf2680697a54. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:18:20.683868 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:18:20.686073 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:18:20.733014 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6999ffb2-cae6-46a5-babc-d6fe2178eac7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623365 Mar 30 07:18:20.734264 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 183/383] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:18:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:18:20.747322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f6572049-6e1d-484e-8802-9b4e2a15e72f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:20.748308 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f6572049-6e1d-484e-8802-9b4e2a15e72f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:20.765096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f8a39dd0-0dee-4b6f-bec2-19579747c1fa tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:20.766601 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f8a39dd0-0dee-4b6f-bec2-19579747c1fa tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:20.784012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f8a39dd0-0dee-4b6f-bec2-19579747c1fa tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:20.784505 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f8a39dd0-0dee-4b6f-bec2-19579747c1fa tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:20.785370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f8a39dd0-0dee-4b6f-bec2-19579747c1fa tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:20.785804 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f8a39dd0-0dee-4b6f-bec2-19579747c1fa tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:20.843301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f6572049-6e1d-484e-8802-9b4e2a15e72f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:20.851412 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f6572049-6e1d-484e-8802-9b4e2a15e72f tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1218 microversion: 2.1 time: 0.109793 Mar 30 07:18:20.852363 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 201/384] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:20 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:20.987162 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f8a39dd0-0dee-4b6f-bec2-19579747c1fa tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:20.995016 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f8a39dd0-0dee-4b6f-bec2-19579747c1fa tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.234094 Mar 30 07:18:20.995596 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 184/385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:20 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:21.117647 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:21.118255 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:21.124936 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:21.125597 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:21.126370 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:21.126943 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:21.291158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:21.305793 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:21.307924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:21.309139 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-625a8f8e-25f2-4a65-a83a-dd8b9b63faaf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1724 microversion: 2.20 time: 0.195966 Mar 30 07:18:21.309706 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 202/386] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:21 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:18:21.327648 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-869956c4-3435-4807-ac2a-8adf5a88c635 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99d5af1c-b410-4479-a7be-9396c5a59ddc"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:21.329195 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-869956c4-3435-4807-ac2a-8adf5a88c635 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:21.336489 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-869956c4-3435-4807-ac2a-8adf5a88c635 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:21.337187 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-869956c4-3435-4807-ac2a-8adf5a88c635 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:21.337955 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-869956c4-3435-4807-ac2a-8adf5a88c635 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:21.338660 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-869956c4-3435-4807-ac2a-8adf5a88c635 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:21.714253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-869956c4-3435-4807-ac2a-8adf5a88c635 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.391175 Mar 30 07:18:21.719709 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 185/387] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Mar 30 07:18:21 2022] POST /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments => generated 188 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:18:21.837030 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-77330665-8c54-4575-ba05-ffac06ffc583 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:21.837908 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-77330665-8c54-4575-ba05-ffac06ffc583 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:21.844671 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-77330665-8c54-4575-ba05-ffac06ffc583 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:21.845438 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-77330665-8c54-4575-ba05-ffac06ffc583 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:21.846616 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-77330665-8c54-4575-ba05-ffac06ffc583 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:21.847404 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-77330665-8c54-4575-ba05-ffac06ffc583 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:21.869731 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5c0f7041-cd38-4b24-ac23-a59316288f43 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:21.870720 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5c0f7041-cd38-4b24-ac23-a59316288f43 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:21.879923 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5c0f7041-cd38-4b24-ac23-a59316288f43 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:21.880644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5c0f7041-cd38-4b24-ac23-a59316288f43 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:21.881920 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5c0f7041-cd38-4b24-ac23-a59316288f43 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:21.882896 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5c0f7041-cd38-4b24-ac23-a59316288f43 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:21.992101 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-77330665-8c54-4575-ba05-ffac06ffc583 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/action" status: 202 len: 0 microversion: 2.20 time: 0.159242 Mar 30 07:18:21.995742 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 203/388] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Mar 30 07:18:21 2022] POST /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:18:22.005207 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5c0f7041-cd38-4b24-ac23-a59316288f43 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:22.014032 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5c0f7041-cd38-4b24-ac23-a59316288f43 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1270 microversion: 2.1 time: 0.148524 Mar 30 07:18:22.024087 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 186/389] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:21 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:22.024301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:22.024301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:22.034438 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:22.036779 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:22.037728 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:22.040851 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:22.046451 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0dd121ab-0e61-453b-adf0-2db8b7f80749 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:22.047226 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0dd121ab-0e61-453b-adf0-2db8b7f80749 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:22.061104 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0dd121ab-0e61-453b-adf0-2db8b7f80749 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:22.061633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0dd121ab-0e61-453b-adf0-2db8b7f80749 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:22.064069 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0dd121ab-0e61-453b-adf0-2db8b7f80749 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:22.064523 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0dd121ab-0e61-453b-adf0-2db8b7f80749 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:22.351927 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:22.360289 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:22.361785 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:22.362955 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a3395ea6-2574-47ec-a899-783428e51d7a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1750 microversion: 2.20 time: 0.355027 Mar 30 07:18:22.370986 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 204/390] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:21 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1750 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:18:22.435531 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0dd121ab-0e61-453b-adf0-2db8b7f80749 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:22.444348 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0dd121ab-0e61-453b-adf0-2db8b7f80749 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.428378 Mar 30 07:18:22.455456 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 187/391] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:22 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:23.045845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-009fd778-3bfb-41d6-ab25-a2e8fb7f3174 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:23.046938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-009fd778-3bfb-41d6-ab25-a2e8fb7f3174 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:23.055225 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-009fd778-3bfb-41d6-ab25-a2e8fb7f3174 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:23.056057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-009fd778-3bfb-41d6-ab25-a2e8fb7f3174 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:23.057145 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-009fd778-3bfb-41d6-ab25-a2e8fb7f3174 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:23.057810 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-009fd778-3bfb-41d6-ab25-a2e8fb7f3174 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:23.313124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-009fd778-3bfb-41d6-ab25-a2e8fb7f3174 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:23.324649 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-009fd778-3bfb-41d6-ab25-a2e8fb7f3174 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.296847 Mar 30 07:18:23.325249 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 205/392] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:23 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:23.385352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:23.386742 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:23.393887 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:23.394679 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:23.395666 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:23.396321 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:23.463888 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-df76c23d-b57b-4de8-9aa7-d9dc14e75835 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:23.465514 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-df76c23d-b57b-4de8-9aa7-d9dc14e75835 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:23.475676 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-df76c23d-b57b-4de8-9aa7-d9dc14e75835 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:23.476816 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-df76c23d-b57b-4de8-9aa7-d9dc14e75835 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:23.479376 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-df76c23d-b57b-4de8-9aa7-d9dc14e75835 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:23.480853 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-df76c23d-b57b-4de8-9aa7-d9dc14e75835 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:23.651758 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:23.660894 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:23.667767 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:23.670860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a658fa83-94de-44de-935e-66bdfaee6c69 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1750 microversion: 2.20 time: 0.292648 Mar 30 07:18:23.688206 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 188/393] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:23 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1750 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:23.790384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-df76c23d-b57b-4de8-9aa7-d9dc14e75835 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:23.798872 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-df76c23d-b57b-4de8-9aa7-d9dc14e75835 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.340089 Mar 30 07:18:23.812332 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 206/394] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:23 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:24.273378 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-17b591cb-6683-4dd0-82a2-51c13b5cfd82 req-0745a8bb-5677-4403-8007-249b29e88e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2d7ec4-d372-450c-9824-3bd310322805", "tag": "70352c24-989e-4e65-8b8f-ad572660b266"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:24.283562 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-17b591cb-6683-4dd0-82a2-51c13b5cfd82 req-0745a8bb-5677-4403-8007-249b29e88e37 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:24.284403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-17b591cb-6683-4dd0-82a2-51c13b5cfd82 req-0745a8bb-5677-4403-8007-249b29e88e37 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:24.298580 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-17b591cb-6683-4dd0-82a2-51c13b5cfd82 req-0745a8bb-5677-4403-8007-249b29e88e37 service nova] Creating event network-changed:70352c24-989e-4e65-8b8f-ad572660b266 for instance ee2d7ec4-d372-450c-9824-3bd310322805 on hv-cinder-83577 Mar 30 07:18:24.306316 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-17b591cb-6683-4dd0-82a2-51c13b5cfd82 req-0745a8bb-5677-4403-8007-249b29e88e37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037008 Mar 30 07:18:24.307139 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 189/395] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:18:24.342027 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6f2218af-49bf-4380-8fb3-d5d15dd42303 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:24.343211 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6f2218af-49bf-4380-8fb3-d5d15dd42303 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:24.359656 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f2218af-49bf-4380-8fb3-d5d15dd42303 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:24.361355 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f2218af-49bf-4380-8fb3-d5d15dd42303 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:24.362290 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f2218af-49bf-4380-8fb3-d5d15dd42303 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:24.362811 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f2218af-49bf-4380-8fb3-d5d15dd42303 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:24.565505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6f2218af-49bf-4380-8fb3-d5d15dd42303 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:24.575974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6f2218af-49bf-4380-8fb3-d5d15dd42303 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.238003 Mar 30 07:18:24.577378 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 207/396] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:24 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:24.702094 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:24.702961 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:24.709871 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:24.710350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:24.711225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:24.711654 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:24.817979 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5dc84f58-c56b-4155-bb2e-4bb525123533 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:24.821951 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5dc84f58-c56b-4155-bb2e-4bb525123533 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:24.836486 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5dc84f58-c56b-4155-bb2e-4bb525123533 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:24.837247 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5dc84f58-c56b-4155-bb2e-4bb525123533 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:24.838639 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5dc84f58-c56b-4155-bb2e-4bb525123533 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:24.839687 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5dc84f58-c56b-4155-bb2e-4bb525123533 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:25.037167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:25.047259 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:25.048828 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:25.050012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cff15d75-f7f6-42f3-93cf-4ce5a6042ac5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1752 microversion: 2.20 time: 0.355048 Mar 30 07:18:25.050572 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 190/397] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:24 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1752 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:25.181600 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5dc84f58-c56b-4155-bb2e-4bb525123533 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:25.227284 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5dc84f58-c56b-4155-bb2e-4bb525123533 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.397621 Mar 30 07:18:25.229295 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 208/398] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:24 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:25.598563 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9fbc22aa-58be-4119-b30e-f611bc729119 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:25.599440 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9fbc22aa-58be-4119-b30e-f611bc729119 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:25.606358 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9fbc22aa-58be-4119-b30e-f611bc729119 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:25.607011 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9fbc22aa-58be-4119-b30e-f611bc729119 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:25.607973 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9fbc22aa-58be-4119-b30e-f611bc729119 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:25.608569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9fbc22aa-58be-4119-b30e-f611bc729119 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:25.760607 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9fbc22aa-58be-4119-b30e-f611bc729119 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:25.774571 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9fbc22aa-58be-4119-b30e-f611bc729119 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.180027 Mar 30 07:18:25.784110 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 191/399] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:25 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:26.068601 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:26.069195 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:26.076256 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:26.076692 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:26.077623 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:26.078374 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:26.249073 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-97e5b828-1a9f-411e-a45a-5a21a8a5e968 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:26.249685 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-97e5b828-1a9f-411e-a45a-5a21a8a5e968 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:26.261456 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-97e5b828-1a9f-411e-a45a-5a21a8a5e968 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:26.262187 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-97e5b828-1a9f-411e-a45a-5a21a8a5e968 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:26.263164 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-97e5b828-1a9f-411e-a45a-5a21a8a5e968 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:26.263841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-97e5b828-1a9f-411e-a45a-5a21a8a5e968 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:26.272893 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:26.284303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:26.286416 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:26.288130 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0a19f785-ebd3-4909-88e1-70dfa6ffc114 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.223201 Mar 30 07:18:26.301135 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 209/400] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:26 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:26.442410 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-97e5b828-1a9f-411e-a45a-5a21a8a5e968 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:26.452518 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-97e5b828-1a9f-411e-a45a-5a21a8a5e968 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.207166 Mar 30 07:18:26.453374 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 192/401] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:26 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:26.799176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4e09ddaf-2006-4573-821e-a270cc793655 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:26.800534 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4e09ddaf-2006-4573-821e-a270cc793655 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:26.808202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4e09ddaf-2006-4573-821e-a270cc793655 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:26.808870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4e09ddaf-2006-4573-821e-a270cc793655 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:26.809808 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4e09ddaf-2006-4573-821e-a270cc793655 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:26.810373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4e09ddaf-2006-4573-821e-a270cc793655 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:26.834957 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-529e79db-9d10-40d9-bb08-9f3f8c51446e req-b366c78f-6297-4238-b607-b8b9db28973f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55662b82-58b5-4206-a411-103fac11b0b2", "name": "network-vif-plugged", "status": "completed", "tag": "c73621da-1c9c-4d35-9b39-2038b6ae4204"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:26.845160 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-529e79db-9d10-40d9-bb08-9f3f8c51446e req-b366c78f-6297-4238-b607-b8b9db28973f service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:26.845736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-529e79db-9d10-40d9-bb08-9f3f8c51446e req-b366c78f-6297-4238-b607-b8b9db28973f service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:26.869538 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-529e79db-9d10-40d9-bb08-9f3f8c51446e req-b366c78f-6297-4238-b607-b8b9db28973f service nova] Creating event network-vif-plugged:c73621da-1c9c-4d35-9b39-2038b6ae4204 for instance 55662b82-58b5-4206-a411-103fac11b0b2 on hv-cinder-83577 Mar 30 07:18:26.874728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-529e79db-9d10-40d9-bb08-9f3f8c51446e req-b366c78f-6297-4238-b607-b8b9db28973f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043821 Mar 30 07:18:26.875687 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 193/402] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:18:27.033889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4e09ddaf-2006-4573-821e-a270cc793655 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:27.057091 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4e09ddaf-2006-4573-821e-a270cc793655 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.266910 Mar 30 07:18:27.070784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 210/403] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:26 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:27.309334 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:27.310723 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:27.329507 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:27.331837 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:27.332744 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:27.334833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:27.471355 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1342aec9-2484-4559-8a8f-40d8d7b4130b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:27.472040 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1342aec9-2484-4559-8a8f-40d8d7b4130b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:27.483370 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1342aec9-2484-4559-8a8f-40d8d7b4130b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:27.483837 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1342aec9-2484-4559-8a8f-40d8d7b4130b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:27.486835 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1342aec9-2484-4559-8a8f-40d8d7b4130b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:27.487968 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1342aec9-2484-4559-8a8f-40d8d7b4130b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:27.541851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:27.551640 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:27.553414 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:27.555059 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-be8b9d7d-50dd-4c61-9bab-750877087f0d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.251395 Mar 30 07:18:27.566505 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 194/404] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:27 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:27.743023 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1342aec9-2484-4559-8a8f-40d8d7b4130b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:27.752021 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1342aec9-2484-4559-8a8f-40d8d7b4130b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.284941 Mar 30 07:18:27.755093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 211/405] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:27 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:28.077995 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5365c479-85b1-4dea-adb2-e8ef96406102 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:28.079739 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5365c479-85b1-4dea-adb2-e8ef96406102 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:28.091192 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5365c479-85b1-4dea-adb2-e8ef96406102 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:28.092011 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5365c479-85b1-4dea-adb2-e8ef96406102 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:28.098179 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5365c479-85b1-4dea-adb2-e8ef96406102 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:28.098866 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5365c479-85b1-4dea-adb2-e8ef96406102 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:28.347872 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5365c479-85b1-4dea-adb2-e8ef96406102 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:28.356280 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5365c479-85b1-4dea-adb2-e8ef96406102 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.282077 Mar 30 07:18:28.368135 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 195/406] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:28 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:28.582504 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:28.584028 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:28.600658 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:28.617202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:28.621132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:28.623567 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:28.774249 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9e7fa9c2-45f1-4152-bb7e-89d1f49c030e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:28.776133 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9e7fa9c2-45f1-4152-bb7e-89d1f49c030e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:28.792097 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e7fa9c2-45f1-4152-bb7e-89d1f49c030e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:28.793266 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e7fa9c2-45f1-4152-bb7e-89d1f49c030e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:28.794337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e7fa9c2-45f1-4152-bb7e-89d1f49c030e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:28.794987 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9e7fa9c2-45f1-4152-bb7e-89d1f49c030e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:28.951989 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:28.971563 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:28.973690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:28.976028 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fb703092-d774-4045-974a-538ec9670fb9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.397164 Mar 30 07:18:28.978275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 212/407] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:28 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:29.141152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9e7fa9c2-45f1-4152-bb7e-89d1f49c030e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:29.155219 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9e7fa9c2-45f1-4152-bb7e-89d1f49c030e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.386579 Mar 30 07:18:29.156539 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 196/408] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:28 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:29.377931 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a7c3020b-57de-44ee-bb77-a4b6b1e9eb30 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:29.378533 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a7c3020b-57de-44ee-bb77-a4b6b1e9eb30 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:29.384775 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7c3020b-57de-44ee-bb77-a4b6b1e9eb30 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:29.385216 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7c3020b-57de-44ee-bb77-a4b6b1e9eb30 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:29.385994 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7c3020b-57de-44ee-bb77-a4b6b1e9eb30 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:29.386520 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7c3020b-57de-44ee-bb77-a4b6b1e9eb30 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:29.737160 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a7c3020b-57de-44ee-bb77-a4b6b1e9eb30 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:29.752609 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a7c3020b-57de-44ee-bb77-a4b6b1e9eb30 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.378577 Mar 30 07:18:29.755691 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 213/409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:29 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:29.995298 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:29.996060 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:30.007903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:30.008654 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:30.009726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:30.012382 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:30.179425 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-74932bc4-8e69-4a02-9f68-1e64b0c735ad tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:30.180138 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-74932bc4-8e69-4a02-9f68-1e64b0c735ad tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:30.197023 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74932bc4-8e69-4a02-9f68-1e64b0c735ad tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:30.197023 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74932bc4-8e69-4a02-9f68-1e64b0c735ad tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:30.197909 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74932bc4-8e69-4a02-9f68-1e64b0c735ad tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:30.198493 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-74932bc4-8e69-4a02-9f68-1e64b0c735ad tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:30.413356 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:30.419991 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:30.426389 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:30.429832 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-57970412-f2d2-4e29-af8b-f5d0d4244a7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.439021 Mar 30 07:18:30.446457 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 197/410] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:29 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:30.528293 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-74932bc4-8e69-4a02-9f68-1e64b0c735ad tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:30.535560 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-74932bc4-8e69-4a02-9f68-1e64b0c735ad tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.366687 Mar 30 07:18:30.544720 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 214/411] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:30 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:30.772064 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-846e0ec7-26da-4773-9d8d-1d6da7906988 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:30.773419 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-846e0ec7-26da-4773-9d8d-1d6da7906988 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:30.785109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-846e0ec7-26da-4773-9d8d-1d6da7906988 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:30.785859 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-846e0ec7-26da-4773-9d8d-1d6da7906988 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:30.792602 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-846e0ec7-26da-4773-9d8d-1d6da7906988 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:30.793258 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-846e0ec7-26da-4773-9d8d-1d6da7906988 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:31.074284 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-846e0ec7-26da-4773-9d8d-1d6da7906988 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:31.090611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-846e0ec7-26da-4773-9d8d-1d6da7906988 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.321294 Mar 30 07:18:31.091431 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 198/412] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:30 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:31.448856 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:31.450365 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:31.462525 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:31.465234 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:31.466270 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:31.468373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:31.552965 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9c8d9d87-3ff2-4cb6-b85b-fb49e17d9f82 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:31.554396 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9c8d9d87-3ff2-4cb6-b85b-fb49e17d9f82 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:31.565993 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9c8d9d87-3ff2-4cb6-b85b-fb49e17d9f82 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:31.571091 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9c8d9d87-3ff2-4cb6-b85b-fb49e17d9f82 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:31.580883 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9c8d9d87-3ff2-4cb6-b85b-fb49e17d9f82 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:31.583144 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9c8d9d87-3ff2-4cb6-b85b-fb49e17d9f82 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:31.826897 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:31.839596 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:31.842056 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:31.845772 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7c766128-7462-4652-92bf-c55239f8ab6e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.401856 Mar 30 07:18:31.848606 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 215/413] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:31 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:31.909716 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9c8d9d87-3ff2-4cb6-b85b-fb49e17d9f82 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:31.918090 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9c8d9d87-3ff2-4cb6-b85b-fb49e17d9f82 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.369420 Mar 30 07:18:31.922076 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 199/414] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:31 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:32.110131 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bcdcfc4c-ba59-488e-b6a1-fe3d17821f89 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:32.110757 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bcdcfc4c-ba59-488e-b6a1-fe3d17821f89 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:32.125619 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bcdcfc4c-ba59-488e-b6a1-fe3d17821f89 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:32.126074 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bcdcfc4c-ba59-488e-b6a1-fe3d17821f89 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:32.127861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bcdcfc4c-ba59-488e-b6a1-fe3d17821f89 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:32.127861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bcdcfc4c-ba59-488e-b6a1-fe3d17821f89 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:32.397544 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bcdcfc4c-ba59-488e-b6a1-fe3d17821f89 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:32.424944 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bcdcfc4c-ba59-488e-b6a1-fe3d17821f89 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.317808 Mar 30 07:18:32.427793 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 216/415] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:32 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:32.865512 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:32.866850 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:32.886330 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:32.887088 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:32.888098 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:32.888688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:32.937073 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2ddaad1f-4146-42f3-aa53-cab98a074d29 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:32.938499 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2ddaad1f-4146-42f3-aa53-cab98a074d29 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:32.953826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2ddaad1f-4146-42f3-aa53-cab98a074d29 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:32.957912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2ddaad1f-4146-42f3-aa53-cab98a074d29 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:32.965948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2ddaad1f-4146-42f3-aa53-cab98a074d29 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:32.966682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2ddaad1f-4146-42f3-aa53-cab98a074d29 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:33.360320 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:33.369500 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:33.381911 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:33.383466 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2f52e3d8-2a54-4ec7-b434-ebaa341a714f tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.522077 Mar 30 07:18:33.384554 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 200/416] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:32 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:33.389413 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-7769d78f-f486-430e-82a5-0552f085ede0 req-c7de4f94-813e-476b-9c1b-11a9577e1cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2d7ec4-d372-450c-9824-3bd310322805", "name": "network-vif-plugged", "status": "completed", "tag": "70352c24-989e-4e65-8b8f-ad572660b266"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:33.433957 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7769d78f-f486-430e-82a5-0552f085ede0 req-c7de4f94-813e-476b-9c1b-11a9577e1cab service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:33.434898 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7769d78f-f486-430e-82a5-0552f085ede0 req-c7de4f94-813e-476b-9c1b-11a9577e1cab service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:33.462180 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-7769d78f-f486-430e-82a5-0552f085ede0 req-c7de4f94-813e-476b-9c1b-11a9577e1cab service nova] Creating event network-vif-plugged:70352c24-989e-4e65-8b8f-ad572660b266 for instance ee2d7ec4-d372-450c-9824-3bd310322805 on hv-cinder-83577 Mar 30 07:18:33.482072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-7769d78f-f486-430e-82a5-0552f085ede0 req-c7de4f94-813e-476b-9c1b-11a9577e1cab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096090 Mar 30 07:18:33.482701 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 201/417] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:18:33.497719 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a1fa192f-76e5-4e8d-8068-ea704aa9fbae tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:33.498434 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a1fa192f-76e5-4e8d-8068-ea704aa9fbae tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:33.505635 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2ddaad1f-4146-42f3-aa53-cab98a074d29 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:33.521847 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2ddaad1f-4146-42f3-aa53-cab98a074d29 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1370 microversion: 2.1 time: 0.586168 Mar 30 07:18:33.522113 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a1fa192f-76e5-4e8d-8068-ea704aa9fbae tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:33.522550 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a1fa192f-76e5-4e8d-8068-ea704aa9fbae tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:33.523359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a1fa192f-76e5-4e8d-8068-ea704aa9fbae tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:33.523797 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a1fa192f-76e5-4e8d-8068-ea704aa9fbae tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:33.524263 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 217/418] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:32 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1370 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:33.848120 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a1fa192f-76e5-4e8d-8068-ea704aa9fbae tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:33.864819 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a1fa192f-76e5-4e8d-8068-ea704aa9fbae tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.375536 Mar 30 07:18:33.866148 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 202/419] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:33 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:34.402058 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:34.402630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:34.410863 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:34.410863 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:34.410863 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:34.410863 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:34.538675 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1cf91296-f842-4929-8435-34035b71f36f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:34.539288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1cf91296-f842-4929-8435-34035b71f36f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:34.552706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1cf91296-f842-4929-8435-34035b71f36f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:34.553507 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1cf91296-f842-4929-8435-34035b71f36f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:34.554481 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1cf91296-f842-4929-8435-34035b71f36f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:34.555229 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1cf91296-f842-4929-8435-34035b71f36f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:34.674651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:34.692039 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:34.693534 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:34.703999 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4957dd8c-321d-4ce6-b842-8ccb836af853 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.302699 Mar 30 07:18:34.715129 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 218/420] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:34 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:34.825462 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1cf91296-f842-4929-8435-34035b71f36f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:34.843122 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1cf91296-f842-4929-8435-34035b71f36f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1565 microversion: 2.1 time: 0.308279 Mar 30 07:18:34.845325 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 203/421] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:34 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1565 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:34.861774 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-afa52a4e-1fde-45a1-b6d5-f3623f7eae59 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:34.862498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-afa52a4e-1fde-45a1-b6d5-f3623f7eae59 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:34.869090 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-afa52a4e-1fde-45a1-b6d5-f3623f7eae59 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:34.869776 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-afa52a4e-1fde-45a1-b6d5-f3623f7eae59 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:34.870899 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-afa52a4e-1fde-45a1-b6d5-f3623f7eae59 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:34.871485 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-afa52a4e-1fde-45a1-b6d5-f3623f7eae59 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:34.883083 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a4ac1f1a-cda6-48bf-9cf1-580da589a806 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:34.883705 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a4ac1f1a-cda6-48bf-9cf1-580da589a806 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:34.911896 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f1a-cda6-48bf-9cf1-580da589a806 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:34.913561 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f1a-cda6-48bf-9cf1-580da589a806 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:34.916150 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f1a-cda6-48bf-9cf1-580da589a806 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:34.917930 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f1a-cda6-48bf-9cf1-580da589a806 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:35.052772 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-afa52a4e-1fde-45a1-b6d5-f3623f7eae59 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194715 Mar 30 07:18:35.053732 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 219/422] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Mar 30 07:18:34 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:18:35.289082 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a4ac1f1a-cda6-48bf-9cf1-580da589a806 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:35.300246 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a4ac1f1a-cda6-48bf-9cf1-580da589a806 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.421600 Mar 30 07:18:35.316969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 204/423] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:34 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:35.722393 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:35.722956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:35.729190 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:35.730211 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:35.731178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:35.731604 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:36.061213 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:36.070911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:36.073012 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:36.074556 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d418872f-073a-4106-bf5a-298aa6a7343c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.356801 Mar 30 07:18:36.086275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 220/424] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:35 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:36.326138 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c3302fb0-bf3f-4de5-8f6e-c6e21322097b tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:36.327521 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c3302fb0-bf3f-4de5-8f6e-c6e21322097b tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:36.334560 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c3302fb0-bf3f-4de5-8f6e-c6e21322097b tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:36.335384 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c3302fb0-bf3f-4de5-8f6e-c6e21322097b tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:36.336561 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c3302fb0-bf3f-4de5-8f6e-c6e21322097b tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:36.337071 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c3302fb0-bf3f-4de5-8f6e-c6e21322097b tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:36.625802 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c3302fb0-bf3f-4de5-8f6e-c6e21322097b tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:36.637295 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c3302fb0-bf3f-4de5-8f6e-c6e21322097b tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.316819 Mar 30 07:18:36.639350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 205/425] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:36 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:18:36.823429 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-a293178b-1301-4945-a689-88cf3885b02d req-dc0f0b0a-2970-429e-8baf-e821c517eea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55662b82-58b5-4206-a411-103fac11b0b2", "tag": "c73621da-1c9c-4d35-9b39-2038b6ae4204"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:36.835259 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a293178b-1301-4945-a689-88cf3885b02d req-dc0f0b0a-2970-429e-8baf-e821c517eea0 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:36.836041 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a293178b-1301-4945-a689-88cf3885b02d req-dc0f0b0a-2970-429e-8baf-e821c517eea0 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:36.877605 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-a293178b-1301-4945-a689-88cf3885b02d req-dc0f0b0a-2970-429e-8baf-e821c517eea0 service nova] Creating event network-changed:c73621da-1c9c-4d35-9b39-2038b6ae4204 for instance 55662b82-58b5-4206-a411-103fac11b0b2 on hv-cinder-83577 Mar 30 07:18:36.883800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-a293178b-1301-4945-a689-88cf3885b02d req-dc0f0b0a-2970-429e-8baf-e821c517eea0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065139 Mar 30 07:18:36.885054 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 221/426] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:18:37.103128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:37.104012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:37.135385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:37.136187 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:37.137130 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:37.137914 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:37.414504 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:37.425186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:37.430303 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:37.431510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-53a9e57c-ce7b-4051-8492-adf3d83ac3c3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.334521 Mar 30 07:18:37.435731 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 206/427] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:37 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:37.657657 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ddf04849-3bed-43c8-b243-adf82e4c0db7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:37.659271 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ddf04849-3bed-43c8-b243-adf82e4c0db7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:37.667454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ddf04849-3bed-43c8-b243-adf82e4c0db7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:37.668910 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ddf04849-3bed-43c8-b243-adf82e4c0db7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:37.669911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ddf04849-3bed-43c8-b243-adf82e4c0db7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:37.670529 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ddf04849-3bed-43c8-b243-adf82e4c0db7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:37.952936 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ddf04849-3bed-43c8-b243-adf82e4c0db7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:37.976161 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ddf04849-3bed-43c8-b243-adf82e4c0db7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.322679 Mar 30 07:18:37.980932 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 222/428] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:37 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:38.450675 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:38.451265 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:38.459117 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:38.462350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:38.462350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:38.462350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:38.606219 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:38.615306 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:38.617396 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:38.618587 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3424635e-5fcc-4816-b1da-f7e0e4714dba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.172331 Mar 30 07:18:38.619178 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 207/429] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:38 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:38.994175 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-dd5ca43d-c55d-4eb3-9c27-a8cf0e1acfa7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:38.994887 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-dd5ca43d-c55d-4eb3-9c27-a8cf0e1acfa7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:39.001522 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dd5ca43d-c55d-4eb3-9c27-a8cf0e1acfa7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:39.002321 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dd5ca43d-c55d-4eb3-9c27-a8cf0e1acfa7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:39.002718 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dd5ca43d-c55d-4eb3-9c27-a8cf0e1acfa7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:39.003188 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dd5ca43d-c55d-4eb3-9c27-a8cf0e1acfa7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:39.140667 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-dd5ca43d-c55d-4eb3-9c27-a8cf0e1acfa7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:39.148995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-dd5ca43d-c55d-4eb3-9c27-a8cf0e1acfa7 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1318 microversion: 2.1 time: 0.158762 Mar 30 07:18:39.149924 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 223/430] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:38 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:39.636909 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:39.637520 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:39.644415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:39.644955 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:39.645811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:39.646288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:39.794508 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:39.802835 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:39.804476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:39.805648 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4522535d-a794-43c8-8a50-c4c5c75512ca tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.172751 Mar 30 07:18:39.806207 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 208/431] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:39 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:18:40.166764 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e03640b6-9187-42f0-992e-a7bed8f2f413 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:40.167386 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e03640b6-9187-42f0-992e-a7bed8f2f413 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:40.174091 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e03640b6-9187-42f0-992e-a7bed8f2f413 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:40.174552 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e03640b6-9187-42f0-992e-a7bed8f2f413 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:40.175345 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e03640b6-9187-42f0-992e-a7bed8f2f413 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:40.175777 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e03640b6-9187-42f0-992e-a7bed8f2f413 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:40.314854 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e03640b6-9187-42f0-992e-a7bed8f2f413 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:40.323382 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e03640b6-9187-42f0-992e-a7bed8f2f413 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1506 microversion: 2.1 time: 0.160714 Mar 30 07:18:40.324120 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 224/432] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:18:40 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:40.342767 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0bfa89fa-2886-4275-8219-66efeead2b9c tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "901fcd89-7fd2-45f8-8e2f-8f27b43c27f2", "device": "/dev/sdb"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:40.344692 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0bfa89fa-2886-4275-8219-66efeead2b9c tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:40.351314 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0bfa89fa-2886-4275-8219-66efeead2b9c tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:40.352062 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0bfa89fa-2886-4275-8219-66efeead2b9c tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:40.352839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0bfa89fa-2886-4275-8219-66efeead2b9c tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:40.353437 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0bfa89fa-2886-4275-8219-66efeead2b9c tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:40.621402 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0bfa89fa-2886-4275-8219-66efeead2b9c tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "POST /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282658 Mar 30 07:18:40.622211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 209/433] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:18:40 2022] POST /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:18:40.825093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:40.825608 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:40.832592 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:40.833130 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:40.833860 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:40.834290 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:40.979269 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:40.989433 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:40.990971 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:40.992201 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-35f49a6b-b22c-4381-bc64-c9eec93dfe20 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.171701 Mar 30 07:18:40.992769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 225/434] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:40 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:42.011882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:42.012287 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:42.019427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:42.019969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:42.020945 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:42.021412 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:42.251360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:42.260255 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:42.261813 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:42.263164 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-55e4b1d3-4a07-400e-a5c7-19fc80abe331 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.256836 Mar 30 07:18:42.263718 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 210/435] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:42 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:43.284915 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:43.286202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:43.307767 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:43.309081 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:43.310237 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:43.310876 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:43.685052 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:43.703252 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:43.705673 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:43.708060 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bebae18e-9f87-4585-ab0c-82b560a1511d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.430103 Mar 30 07:18:43.709427 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 226/436] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:43 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:18:44.729633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:44.731206 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:44.739087 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:44.739716 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:44.740702 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:44.741300 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:44.864204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-3102391a-098b-4011-8d4e-1efe7e054fee req-e24dc5fa-01c4-4bee-a3de-d23c9a7c35ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977a73f-876d-4d10-adf8-326ed77fc467", "name": "network-vif-plugged", "status": "completed", "tag": "46952506-ed7a-47ba-a4d4-3306605e4824"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:44.879769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-3102391a-098b-4011-8d4e-1efe7e054fee req-e24dc5fa-01c4-4bee-a3de-d23c9a7c35ee service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:44.882650 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-3102391a-098b-4011-8d4e-1efe7e054fee req-e24dc5fa-01c4-4bee-a3de-d23c9a7c35ee service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:44.909321 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-3102391a-098b-4011-8d4e-1efe7e054fee req-e24dc5fa-01c4-4bee-a3de-d23c9a7c35ee service nova] Creating event network-vif-plugged:46952506-ed7a-47ba-a4d4-3306605e4824 for instance d977a73f-876d-4d10-adf8-326ed77fc467 on hv-cinder-83577 Mar 30 07:18:44.914436 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:44.919446 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-3102391a-098b-4011-8d4e-1efe7e054fee req-e24dc5fa-01c4-4bee-a3de-d23c9a7c35ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058254 Mar 30 07:18:44.920637 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 227/437] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:18:44.931428 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:44.932959 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:44.934319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2514f8c3-2f8a-4398-95bc-10e818ff28c2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.210475 Mar 30 07:18:44.935362 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 211/438] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:44 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:45.956865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:45.957591 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:45.964081 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:45.964461 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:45.965254 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:45.965689 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:46.120193 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:46.128961 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:46.130451 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:46.131743 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f5059480-5eb9-41c4-8b31-e190e9d5a311 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.182987 Mar 30 07:18:46.132553 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 228/439] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:45 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:47.152538 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:47.154727 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:47.164349 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:47.164866 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:47.165720 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:47.166260 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:47.364253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:47.377820 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:47.380775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:47.382300 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-de018d7b-1d2c-4bbf-ae5a-ea95be773fef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1808 microversion: 2.20 time: 0.235647 Mar 30 07:18:47.383900 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 212/440] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:47 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:18:48.403015 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:48.404554 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:48.412395 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:48.413958 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:48.421219 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:48.424169 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:48.593044 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:48.607124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:48.609877 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:18:48.611140 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e795e77e-037d-4b66-9731-e168e2e1041b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1795 microversion: 2.20 time: 0.213303 Mar 30 07:18:48.612239 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 229/441] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:18:48 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1795 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:18:51.808262 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b5b60e3a-0452-45e7-a8f9-bed424066fc3 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Action: 'create', calling method: .version_select at 0x7f153ffb2d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1995633863"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:18:51.824213 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-b5b60e3a-0452-45e7-a8f9-bed424066fc3 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Getting quotas for project 0b879ef71fe5494cadf6882b4230511a. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:18:51.828434 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-b5b60e3a-0452-45e7-a8f9-bed424066fc3 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Getting quotas for user 0034481ab42c4890a835c6876d7fcca7 and project 0b879ef71fe5494cadf6882b4230511a. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:18:52.020397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-b5b60e3a-0452-45e7-a8f9-bed424066fc3 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Getting quotas for project 0b879ef71fe5494cadf6882b4230511a. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:18:52.024164 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-b5b60e3a-0452-45e7-a8f9-bed424066fc3 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Getting quotas for user 0034481ab42c4890a835c6876d7fcca7 and project 0b879ef71fe5494cadf6882b4230511a. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:18:52.037699 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b5b60e3a-0452-45e7-a8f9-bed424066fc3 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.446035 Mar 30 07:18:52.038419 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 213/442] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:18:51 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:18:58.398206 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a7d31347-37db-4762-9db6-1be994d62145 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:18:58.398787 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a7d31347-37db-4762-9db6-1be994d62145 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:18:58.405384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7d31347-37db-4762-9db6-1be994d62145 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:58.405840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7d31347-37db-4762-9db6-1be994d62145 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:58.406609 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7d31347-37db-4762-9db6-1be994d62145 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:18:58.407042 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7d31347-37db-4762-9db6-1be994d62145 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:18:58.497800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-a7d31347-37db-4762-9db6-1be994d62145 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lazy-loading 'services' on Instance uuid ea531783-864c-44f2-9311-d1939a112f2b {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:18:58.578101 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a7d31347-37db-4762-9db6-1be994d62145 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/os-volume_attachments/e4c666f5-79bf-4be9-b681-f20d9a61483c" status: 202 len: 0 microversion: 2.1 time: 0.183950 Mar 30 07:18:58.578769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 230/443] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:18:58 2022] DELETE /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/os-volume_attachments/e4c666f5-79bf-4be9-b681-f20d9a61483c => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:19:00.254285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-15f35f92-47b3-4404-b9e6-4b0ac48f5704 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:00.254784 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-15f35f92-47b3-4404-b9e6-4b0ac48f5704 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:00.261901 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-15f35f92-47b3-4404-b9e6-4b0ac48f5704 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:00.262356 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-15f35f92-47b3-4404-b9e6-4b0ac48f5704 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:00.263122 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-15f35f92-47b3-4404-b9e6-4b0ac48f5704 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:00.263557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-15f35f92-47b3-4404-b9e6-4b0ac48f5704 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:00.388954 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-15f35f92-47b3-4404-b9e6-4b0ac48f5704 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lazy-loading 'services' on Instance uuid ee2d7ec4-d372-450c-9824-3bd310322805 {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:19:00.509914 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-15f35f92-47b3-4404-b9e6-4b0ac48f5704 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805/os-volume_attachments/901fcd89-7fd2-45f8-8e2f-8f27b43c27f2" status: 202 len: 0 microversion: 2.1 time: 0.260025 Mar 30 07:19:00.510746 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 214/444] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:19:00 2022] DELETE /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805/os-volume_attachments/901fcd89-7fd2-45f8-8e2f-8f27b43c27f2 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:19:00.754636 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-da564fc3-337b-4f3f-a01a-87e7727b3233 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:00.762176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da564fc3-337b-4f3f-a01a-87e7727b3233 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:00.764521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da564fc3-337b-4f3f-a01a-87e7727b3233 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:00.788833 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-da564fc3-337b-4f3f-a01a-87e7727b3233 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Going to try to stop instance {{(pid=117062) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 30 07:19:00.833630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-da564fc3-337b-4f3f-a01a-87e7727b3233 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/action" status: 202 len: 0 microversion: 2.1 time: 0.085933 Mar 30 07:19:00.834289 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 231/445] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:19:00 2022] POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:19:00.842986 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1112bf87-8e88-491f-8ddf-62dd25a65e96 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:00.843995 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1112bf87-8e88-491f-8ddf-62dd25a65e96 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:00.850718 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1112bf87-8e88-491f-8ddf-62dd25a65e96 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:00.851220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1112bf87-8e88-491f-8ddf-62dd25a65e96 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:00.852063 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1112bf87-8e88-491f-8ddf-62dd25a65e96 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:00.852500 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1112bf87-8e88-491f-8ddf-62dd25a65e96 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:01.010057 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1112bf87-8e88-491f-8ddf-62dd25a65e96 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:01.020308 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1112bf87-8e88-491f-8ddf-62dd25a65e96 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.181425 Mar 30 07:19:01.021183 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 215/446] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:00 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:02.045354 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-db6c9a11-4f6b-47f6-aa55-0d277ef7c50c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:02.046236 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-db6c9a11-4f6b-47f6-aa55-0d277ef7c50c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:02.053980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-db6c9a11-4f6b-47f6-aa55-0d277ef7c50c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:02.054430 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-db6c9a11-4f6b-47f6-aa55-0d277ef7c50c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:02.055200 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-db6c9a11-4f6b-47f6-aa55-0d277ef7c50c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:02.055635 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-db6c9a11-4f6b-47f6-aa55-0d277ef7c50c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:02.195160 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-db6c9a11-4f6b-47f6-aa55-0d277ef7c50c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:02.202678 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-db6c9a11-4f6b-47f6-aa55-0d277ef7c50c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.165186 Mar 30 07:19:02.203280 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 232/447] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:02 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:02.681305 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0030d2b9-cb61-443e-9af6-d1eccd4b30eb tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:02.681820 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0030d2b9-cb61-443e-9af6-d1eccd4b30eb tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:02.688642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0030d2b9-cb61-443e-9af6-d1eccd4b30eb tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:02.689091 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0030d2b9-cb61-443e-9af6-d1eccd4b30eb tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:02.689943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0030d2b9-cb61-443e-9af6-d1eccd4b30eb tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:02.690374 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0030d2b9-cb61-443e-9af6-d1eccd4b30eb tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:02.714067 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0030d2b9-cb61-443e-9af6-d1eccd4b30eb tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:19:02.797642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0030d2b9-cb61-443e-9af6-d1eccd4b30eb tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 204 len: 0 microversion: 2.1 time: 0.119869 Mar 30 07:19:02.798133 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 216/448] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:19:02 2022] DELETE /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:19:02.806798 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c810fb74-269a-48fb-9b84-cbb770dd11bd tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:02.807494 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c810fb74-269a-48fb-9b84-cbb770dd11bd tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:02.813662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c810fb74-269a-48fb-9b84-cbb770dd11bd tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:02.814109 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c810fb74-269a-48fb-9b84-cbb770dd11bd tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:02.815007 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c810fb74-269a-48fb-9b84-cbb770dd11bd tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:02.815613 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c810fb74-269a-48fb-9b84-cbb770dd11bd tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:02.962913 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c810fb74-269a-48fb-9b84-cbb770dd11bd tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:02.974457 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c810fb74-269a-48fb-9b84-cbb770dd11bd tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1512 microversion: 2.1 time: 0.171295 Mar 30 07:19:02.975224 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 233/449] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:02 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:03.224088 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fa89d75c-66d3-4d55-964d-cb730f3ee719 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:03.224786 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-fa89d75c-66d3-4d55-964d-cb730f3ee719 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:03.231991 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fa89d75c-66d3-4d55-964d-cb730f3ee719 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:03.232445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fa89d75c-66d3-4d55-964d-cb730f3ee719 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:03.233207 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fa89d75c-66d3-4d55-964d-cb730f3ee719 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:03.233638 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fa89d75c-66d3-4d55-964d-cb730f3ee719 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:03.377122 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fa89d75c-66d3-4d55-964d-cb730f3ee719 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:03.385971 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fa89d75c-66d3-4d55-964d-cb730f3ee719 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.167609 Mar 30 07:19:03.386522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 217/450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:03 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:03.996734 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b4d38601-5135-43ee-b6fc-5a2439f6e54a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:03.997351 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b4d38601-5135-43ee-b6fc-5a2439f6e54a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:04.005173 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b4d38601-5135-43ee-b6fc-5a2439f6e54a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:04.005625 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b4d38601-5135-43ee-b6fc-5a2439f6e54a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:04.006372 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b4d38601-5135-43ee-b6fc-5a2439f6e54a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:04.006807 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b4d38601-5135-43ee-b6fc-5a2439f6e54a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:04.152983 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b4d38601-5135-43ee-b6fc-5a2439f6e54a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:04.161036 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b4d38601-5135-43ee-b6fc-5a2439f6e54a tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1512 microversion: 2.1 time: 0.168330 Mar 30 07:19:04.161614 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 234/451] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:03 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:04.408094 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c93a7611-ab80-4217-b18c-2f01f0010f18 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:04.409413 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c93a7611-ab80-4217-b18c-2f01f0010f18 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:04.420014 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c93a7611-ab80-4217-b18c-2f01f0010f18 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:04.420759 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c93a7611-ab80-4217-b18c-2f01f0010f18 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:04.422004 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c93a7611-ab80-4217-b18c-2f01f0010f18 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:04.422708 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c93a7611-ab80-4217-b18c-2f01f0010f18 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:04.561047 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c93a7611-ab80-4217-b18c-2f01f0010f18 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:04.572562 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c93a7611-ab80-4217-b18c-2f01f0010f18 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.170601 Mar 30 07:19:04.573284 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 218/452] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:04 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:05.179315 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-234d9690-8a1c-4a73-b4f9-2dc749616242 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:05.179925 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-234d9690-8a1c-4a73-b4f9-2dc749616242 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:05.186761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-234d9690-8a1c-4a73-b4f9-2dc749616242 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:05.187217 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-234d9690-8a1c-4a73-b4f9-2dc749616242 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:05.188028 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-234d9690-8a1c-4a73-b4f9-2dc749616242 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:05.188463 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-234d9690-8a1c-4a73-b4f9-2dc749616242 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:05.328322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-234d9690-8a1c-4a73-b4f9-2dc749616242 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25ac073374a491899b09b5c7810eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbabd5e38b749abb59cbf2680697a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:05.335795 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-234d9690-8a1c-4a73-b4f9-2dc749616242 tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 200 len: 1512 microversion: 2.1 time: 0.160479 Mar 30 07:19:05.336397 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 235/453] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:05 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:05.592999 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-82893e38-c9ad-4a04-b3ee-9d36fea5a1f2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:05.593591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-82893e38-c9ad-4a04-b3ee-9d36fea5a1f2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:05.604006 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82893e38-c9ad-4a04-b3ee-9d36fea5a1f2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:05.604387 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82893e38-c9ad-4a04-b3ee-9d36fea5a1f2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:05.605577 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82893e38-c9ad-4a04-b3ee-9d36fea5a1f2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:05.606012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82893e38-c9ad-4a04-b3ee-9d36fea5a1f2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:05.656848 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-0b083ea2-ca17-412a-8689-af104cd3525e req-80234ae9-2608-42d5-a222-f9dd247d3e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2d7ec4-d372-450c-9824-3bd310322805", "name": "network-vif-deleted", "tag": "70352c24-989e-4e65-8b8f-ad572660b266"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:05.667150 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-0b083ea2-ca17-412a-8689-af104cd3525e req-80234ae9-2608-42d5-a222-f9dd247d3e14 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:05.667150 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-0b083ea2-ca17-412a-8689-af104cd3525e req-80234ae9-2608-42d5-a222-f9dd247d3e14 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:05.679413 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-0b083ea2-ca17-412a-8689-af104cd3525e req-80234ae9-2608-42d5-a222-f9dd247d3e14 service nova] Creating event network-vif-deleted:70352c24-989e-4e65-8b8f-ad572660b266 for instance ee2d7ec4-d372-450c-9824-3bd310322805 on hv-cinder-83577 Mar 30 07:19:05.684916 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-0b083ea2-ca17-412a-8689-af104cd3525e req-80234ae9-2608-42d5-a222-f9dd247d3e14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032114 Mar 30 07:19:05.685840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 236/454] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:19:05.966421 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-82893e38-c9ad-4a04-b3ee-9d36fea5a1f2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:05.974841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-82893e38-c9ad-4a04-b3ee-9d36fea5a1f2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.385944 Mar 30 07:19:05.975417 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 219/455] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:05 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:06.356358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:06.357150 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] [instance: ee2d7ec4-d372-450c-9824-3bd310322805] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:06.363645 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:06.364096 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:06.364887 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:06.365316 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:06.379428 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] HTTP exception thrown: Instance ee2d7ec4-d372-450c-9824-3bd310322805 could not be found. Mar 30 07:19:06.380082 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] Returning 404 to user: Instance ee2d7ec4-d372-450c-9824-3bd310322805 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:19:06.380948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2161cf63-d354-467c-915c-d9e9f63e4aad tempest-VolumesSnapshotTestJSON-1270594678 tempest-VolumesSnapshotTestJSON-1270594678-project] 10.222.0.20 "GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805" status: 404 len: 111 microversion: 2.1 time: 0.030375 Mar 30 07:19:06.381521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 237/456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:06 2022] GET /compute/v2.1/servers/ee2d7ec4-d372-450c-9824-3bd310322805 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:19:06.997080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d16fe387-cae8-421f-b15e-436fad34053a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:06.998072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d16fe387-cae8-421f-b15e-436fad34053a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:07.006672 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d16fe387-cae8-421f-b15e-436fad34053a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:07.007125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d16fe387-cae8-421f-b15e-436fad34053a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:07.007916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d16fe387-cae8-421f-b15e-436fad34053a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:07.008348 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d16fe387-cae8-421f-b15e-436fad34053a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:07.156346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d16fe387-cae8-421f-b15e-436fad34053a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:07.165766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d16fe387-cae8-421f-b15e-436fad34053a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.175278 Mar 30 07:19:07.166688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 220/457] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:06 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:08.183627 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-45034602-3e40-481d-966a-42d1e8ab6eb8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:08.184358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-45034602-3e40-481d-966a-42d1e8ab6eb8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:08.191141 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-45034602-3e40-481d-966a-42d1e8ab6eb8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:08.191590 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-45034602-3e40-481d-966a-42d1e8ab6eb8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:08.192395 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-45034602-3e40-481d-966a-42d1e8ab6eb8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:08.192824 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-45034602-3e40-481d-966a-42d1e8ab6eb8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:08.350719 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-45034602-3e40-481d-966a-42d1e8ab6eb8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:08.359531 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-45034602-3e40-481d-966a-42d1e8ab6eb8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.179775 Mar 30 07:19:08.360145 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 238/458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:08 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:09.382749 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-12e9dda4-2fc1-4780-ae3d-15582779050b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:09.383902 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-12e9dda4-2fc1-4780-ae3d-15582779050b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:09.397575 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-12e9dda4-2fc1-4780-ae3d-15582779050b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:09.398393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-12e9dda4-2fc1-4780-ae3d-15582779050b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:09.399186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-12e9dda4-2fc1-4780-ae3d-15582779050b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:09.399610 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-12e9dda4-2fc1-4780-ae3d-15582779050b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:09.560270 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-12e9dda4-2fc1-4780-ae3d-15582779050b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:09.568177 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-12e9dda4-2fc1-4780-ae3d-15582779050b tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.193098 Mar 30 07:19:09.568750 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 221/459] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:09 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:10.589715 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-07cd8b09-5bed-482f-a525-2233a9724011 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:10.590695 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-07cd8b09-5bed-482f-a525-2233a9724011 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:10.602182 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-07cd8b09-5bed-482f-a525-2233a9724011 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:10.602623 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-07cd8b09-5bed-482f-a525-2233a9724011 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:10.603390 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-07cd8b09-5bed-482f-a525-2233a9724011 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:10.603848 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-07cd8b09-5bed-482f-a525-2233a9724011 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:10.743752 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-07cd8b09-5bed-482f-a525-2233a9724011 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:10.752702 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-07cd8b09-5bed-482f-a525-2233a9724011 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.169582 Mar 30 07:19:10.753276 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 239/460] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:10 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:11.774471 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e2a2607e-26c8-4fa7-8ac6-fae2bf5cc8a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:11.775249 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e2a2607e-26c8-4fa7-8ac6-fae2bf5cc8a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:11.783086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e2a2607e-26c8-4fa7-8ac6-fae2bf5cc8a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:11.783638 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e2a2607e-26c8-4fa7-8ac6-fae2bf5cc8a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:11.784586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e2a2607e-26c8-4fa7-8ac6-fae2bf5cc8a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:11.785089 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e2a2607e-26c8-4fa7-8ac6-fae2bf5cc8a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:11.930966 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e2a2607e-26c8-4fa7-8ac6-fae2bf5cc8a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:11.938333 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e2a2607e-26c8-4fa7-8ac6-fae2bf5cc8a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.170791 Mar 30 07:19:11.938904 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 222/461] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:11 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:12.957563 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ea038acc-12e4-478a-8e25-5ed4ba72b087 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:12.958285 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ea038acc-12e4-478a-8e25-5ed4ba72b087 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:12.965914 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ea038acc-12e4-478a-8e25-5ed4ba72b087 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:12.966378 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ea038acc-12e4-478a-8e25-5ed4ba72b087 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:12.967119 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ea038acc-12e4-478a-8e25-5ed4ba72b087 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:12.967543 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ea038acc-12e4-478a-8e25-5ed4ba72b087 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:13.113379 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ea038acc-12e4-478a-8e25-5ed4ba72b087 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:13.123317 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ea038acc-12e4-478a-8e25-5ed4ba72b087 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.170754 Mar 30 07:19:13.123893 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 240/462] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:12 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:14.144754 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7b340350-892e-401b-a905-3d6be44cbd85 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:14.145697 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7b340350-892e-401b-a905-3d6be44cbd85 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:14.153799 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7b340350-892e-401b-a905-3d6be44cbd85 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:14.154255 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7b340350-892e-401b-a905-3d6be44cbd85 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:14.155017 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7b340350-892e-401b-a905-3d6be44cbd85 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:14.155426 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7b340350-892e-401b-a905-3d6be44cbd85 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:14.306271 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7b340350-892e-401b-a905-3d6be44cbd85 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:14.318059 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7b340350-892e-401b-a905-3d6be44cbd85 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.179622 Mar 30 07:19:14.318894 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 223/463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:14 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:15.336657 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e8e48a68-b2cd-498e-b8c0-3c10a5e9eb9c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:15.337438 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e8e48a68-b2cd-498e-b8c0-3c10a5e9eb9c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:15.343888 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e8e48a68-b2cd-498e-b8c0-3c10a5e9eb9c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:15.344462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e8e48a68-b2cd-498e-b8c0-3c10a5e9eb9c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:15.345220 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e8e48a68-b2cd-498e-b8c0-3c10a5e9eb9c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:15.345652 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e8e48a68-b2cd-498e-b8c0-3c10a5e9eb9c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:15.486172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e8e48a68-b2cd-498e-b8c0-3c10a5e9eb9c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:15.494115 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e8e48a68-b2cd-498e-b8c0-3c10a5e9eb9c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1679 microversion: 2.1 time: 0.161543 Mar 30 07:19:15.494689 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 241/464] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:15 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:16.512571 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1b8311f1-7557-4f2f-872e-f8a67db70480 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:16.513256 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1b8311f1-7557-4f2f-872e-f8a67db70480 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:16.519609 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1b8311f1-7557-4f2f-872e-f8a67db70480 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:16.520080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1b8311f1-7557-4f2f-872e-f8a67db70480 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:16.520847 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1b8311f1-7557-4f2f-872e-f8a67db70480 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:16.521271 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1b8311f1-7557-4f2f-872e-f8a67db70480 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:16.655737 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-794836174", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1995633863", "security_groups": [{"name": "tempest-secgroup-smoke-653379929"}], "networks": [{"uuid": "378d266e-b6e4-47d5-9ac3-349863fb7ad1"}], "block_device_mapping_v2": [{"uuid": "6d15c512-9bf2-436c-9e8b-44364e232e2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:16.668150 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1b8311f1-7557-4f2f-872e-f8a67db70480 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:16.676350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1b8311f1-7557-4f2f-872e-f8a67db70480 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1656 microversion: 2.1 time: 0.168765 Mar 30 07:19:16.676717 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 224/465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:16 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:16.695785 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-773d4f0d-f1b2-407a-9903-07a6aa4746bd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:16.703756 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-773d4f0d-f1b2-407a-9903-07a6aa4746bd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:16.704255 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-773d4f0d-f1b2-407a-9903-07a6aa4746bd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:16.731172 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-773d4f0d-f1b2-407a-9903-07a6aa4746bd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Going to try to start instance {{(pid=117063) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 30 07:19:16.786558 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] validate_networks() for [('378d266e-b6e4-47d5-9ac3-349863fb7ad1', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:19:16.788939 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-773d4f0d-f1b2-407a-9903-07a6aa4746bd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/action" status: 202 len: 0 microversion: 2.1 time: 0.096592 Mar 30 07:19:16.789554 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 225/466] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:19:16 2022] POST /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 30 07:19:16.798391 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b2980c98-adde-47f0-861a-cce13bcc8244 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:16.799085 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b2980c98-adde-47f0-861a-cce13bcc8244 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:16.806775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b2980c98-adde-47f0-861a-cce13bcc8244 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:16.807217 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b2980c98-adde-47f0-861a-cce13bcc8244 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:16.808277 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b2980c98-adde-47f0-861a-cce13bcc8244 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:16.808700 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b2980c98-adde-47f0-861a-cce13bcc8244 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:17.037423 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b2980c98-adde-47f0-861a-cce13bcc8244 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:17.047774 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b2980c98-adde-47f0-861a-cce13bcc8244 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1665 microversion: 2.1 time: 0.253102 Mar 30 07:19:17.048923 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 226/467] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:16 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1665 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:17.263057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:19:17.263519 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:19:17.264037 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:19:17.264448 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:19:17.264872 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:19:17.273854 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:17.274327 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:17.275115 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:17.275561 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:17.292087 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Getting quotas for project 0b879ef71fe5494cadf6882b4230511a. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:19:17.296092 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Getting quotas for user 0034481ab42c4890a835c6876d7fcca7 and project 0b879ef71fe5494cadf6882b4230511a. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:19:17.356955 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:19:17.359127 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d15c512-9bf2-436c-9e8b-44364e232e2a',volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:19:17.494146 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0b77abd5-e34b-47d7-8386-f4cd7de6a176 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.842486 Mar 30 07:19:17.495053 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 242/468] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:19:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:19:17.507321 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-34ea5ac8-e53a-4f45-b8be-12594bef5e9d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:17.507956 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-34ea5ac8-e53a-4f45-b8be-12594bef5e9d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:17.560161 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-34ea5ac8-e53a-4f45-b8be-12594bef5e9d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:17.566922 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-34ea5ac8-e53a-4f45-b8be-12594bef5e9d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1088 microversion: 2.1 time: 0.064739 Mar 30 07:19:17.567491 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 227/469] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:17 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:18.074495 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e3ebe42c-c571-44f7-839f-262cca119432 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:18.075128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e3ebe42c-c571-44f7-839f-262cca119432 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:18.082252 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e3ebe42c-c571-44f7-839f-262cca119432 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:18.082697 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e3ebe42c-c571-44f7-839f-262cca119432 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:18.083467 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e3ebe42c-c571-44f7-839f-262cca119432 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:18.083921 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e3ebe42c-c571-44f7-839f-262cca119432 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:18.232773 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e3ebe42c-c571-44f7-839f-262cca119432 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:18.240237 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e3ebe42c-c571-44f7-839f-262cca119432 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1665 microversion: 2.1 time: 0.173052 Mar 30 07:19:18.240781 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 243/470] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:18 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:18.588436 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9ed95f41-2d10-49f0-bff6-19d86d7c93ac tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:18.589491 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9ed95f41-2d10-49f0-bff6-19d86d7c93ac tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:18.598724 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9ed95f41-2d10-49f0-bff6-19d86d7c93ac tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:18.599166 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9ed95f41-2d10-49f0-bff6-19d86d7c93ac tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:18.599951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9ed95f41-2d10-49f0-bff6-19d86d7c93ac tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:18.600379 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9ed95f41-2d10-49f0-bff6-19d86d7c93ac tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:18.668527 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9ed95f41-2d10-49f0-bff6-19d86d7c93ac tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:18.676845 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9ed95f41-2d10-49f0-bff6-19d86d7c93ac tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1138 microversion: 2.1 time: 0.094890 Mar 30 07:19:18.677455 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 228/471] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:18 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:19.258446 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-62a00d07-a472-4987-a1ef-52d1098bdffd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:19.259091 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-62a00d07-a472-4987-a1ef-52d1098bdffd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:19.265693 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-62a00d07-a472-4987-a1ef-52d1098bdffd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:19.266146 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-62a00d07-a472-4987-a1ef-52d1098bdffd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:19.266918 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-62a00d07-a472-4987-a1ef-52d1098bdffd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:19.267350 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-62a00d07-a472-4987-a1ef-52d1098bdffd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:19.402664 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-62a00d07-a472-4987-a1ef-52d1098bdffd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:19.410853 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-62a00d07-a472-4987-a1ef-52d1098bdffd tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1665 microversion: 2.1 time: 0.156392 Mar 30 07:19:19.411643 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 244/472] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:19 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:19.693997 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c077c817-ed8c-4ca2-a7f3-202003748838 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:19.694824 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c077c817-ed8c-4ca2-a7f3-202003748838 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:19.701957 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c077c817-ed8c-4ca2-a7f3-202003748838 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:19.702604 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c077c817-ed8c-4ca2-a7f3-202003748838 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:19.703904 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c077c817-ed8c-4ca2-a7f3-202003748838 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:19.703904 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c077c817-ed8c-4ca2-a7f3-202003748838 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:19.768027 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c077c817-ed8c-4ca2-a7f3-202003748838 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:19.776167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c077c817-ed8c-4ca2-a7f3-202003748838 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1186 microversion: 2.1 time: 0.086071 Mar 30 07:19:19.776991 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 229/473] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:19 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:20.434294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4d79dba1-f2dc-4481-93c0-48c34bd8a335 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:20.435368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4d79dba1-f2dc-4481-93c0-48c34bd8a335 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:20.444979 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d79dba1-f2dc-4481-93c0-48c34bd8a335 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:20.445902 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d79dba1-f2dc-4481-93c0-48c34bd8a335 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:20.446957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d79dba1-f2dc-4481-93c0-48c34bd8a335 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:20.448220 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d79dba1-f2dc-4481-93c0-48c34bd8a335 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:20.616506 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4d79dba1-f2dc-4481-93c0-48c34bd8a335 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:20.625187 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4d79dba1-f2dc-4481-93c0-48c34bd8a335 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1665 microversion: 2.1 time: 0.199662 Mar 30 07:19:20.625985 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 245/474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:20 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1665 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:20.793694 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2e1c15de-5029-47ba-9396-bd90c66778af tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:20.794456 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2e1c15de-5029-47ba-9396-bd90c66778af tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:20.801977 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2e1c15de-5029-47ba-9396-bd90c66778af tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:20.802493 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2e1c15de-5029-47ba-9396-bd90c66778af tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:20.805060 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2e1c15de-5029-47ba-9396-bd90c66778af tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:20.805673 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2e1c15de-5029-47ba-9396-bd90c66778af tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:20.944811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2e1c15de-5029-47ba-9396-bd90c66778af tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:20.953151 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2e1c15de-5029-47ba-9396-bd90c66778af tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1271 microversion: 2.1 time: 0.163332 Mar 30 07:19:20.953951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 230/475] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:20 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:21.313005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-833b5e65-42e1-4e4a-983f-3e6a0ac7fbcd req-48df5f1b-565d-45c3-86de-055794f33b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1770fd40-dd13-44c5-a045-2552bc5420dd", "tag": "2b0baaac-04a3-4147-9d07-17d4bc9c6c36"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:21.322527 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-833b5e65-42e1-4e4a-983f-3e6a0ac7fbcd req-48df5f1b-565d-45c3-86de-055794f33b60 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:21.322960 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-833b5e65-42e1-4e4a-983f-3e6a0ac7fbcd req-48df5f1b-565d-45c3-86de-055794f33b60 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:21.334584 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-833b5e65-42e1-4e4a-983f-3e6a0ac7fbcd req-48df5f1b-565d-45c3-86de-055794f33b60 service nova] Creating event network-changed:2b0baaac-04a3-4147-9d07-17d4bc9c6c36 for instance 1770fd40-dd13-44c5-a045-2552bc5420dd on hv-cinder-83577 Mar 30 07:19:21.339636 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-833b5e65-42e1-4e4a-983f-3e6a0ac7fbcd req-48df5f1b-565d-45c3-86de-055794f33b60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031110 Mar 30 07:19:21.340475 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 246/476] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:19:21.641956 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5d69f696-d21f-4493-b734-f42a0245107d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:21.642808 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5d69f696-d21f-4493-b734-f42a0245107d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:21.648856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5d69f696-d21f-4493-b734-f42a0245107d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:21.649357 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5d69f696-d21f-4493-b734-f42a0245107d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:21.650097 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5d69f696-d21f-4493-b734-f42a0245107d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:21.650688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5d69f696-d21f-4493-b734-f42a0245107d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:21.803926 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5d69f696-d21f-4493-b734-f42a0245107d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:21.817458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5d69f696-d21f-4493-b734-f42a0245107d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1669 microversion: 2.1 time: 0.179146 Mar 30 07:19:21.818269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 231/477] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:21 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1669 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:21.971739 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-79903822-4d8d-4fd7-91b7-0c13fe603997 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:21.972589 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-79903822-4d8d-4fd7-91b7-0c13fe603997 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:21.979155 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-79903822-4d8d-4fd7-91b7-0c13fe603997 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:21.980651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-79903822-4d8d-4fd7-91b7-0c13fe603997 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:21.981426 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-79903822-4d8d-4fd7-91b7-0c13fe603997 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:21.981857 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-79903822-4d8d-4fd7-91b7-0c13fe603997 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:22.121768 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-79903822-4d8d-4fd7-91b7-0c13fe603997 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:22.130105 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-79903822-4d8d-4fd7-91b7-0c13fe603997 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.163294 Mar 30 07:19:22.130683 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 247/478] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:21 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:23.151412 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1f23db51-faf0-44e2-8bd9-6e0a156ee2bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:23.152445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1f23db51-faf0-44e2-8bd9-6e0a156ee2bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:23.163061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1f23db51-faf0-44e2-8bd9-6e0a156ee2bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:23.163797 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1f23db51-faf0-44e2-8bd9-6e0a156ee2bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:23.165132 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1f23db51-faf0-44e2-8bd9-6e0a156ee2bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:23.165828 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1f23db51-faf0-44e2-8bd9-6e0a156ee2bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:23.312726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1f23db51-faf0-44e2-8bd9-6e0a156ee2bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:23.320459 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1f23db51-faf0-44e2-8bd9-6e0a156ee2bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.175542 Mar 30 07:19:23.321062 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 232/479] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:23 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:24.338415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-97eaecca-9344-470b-ab21-306b67f561ea tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:24.339006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-97eaecca-9344-470b-ab21-306b67f561ea tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:24.346156 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-97eaecca-9344-470b-ab21-306b67f561ea tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:24.347046 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-97eaecca-9344-470b-ab21-306b67f561ea tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:24.347394 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-97eaecca-9344-470b-ab21-306b67f561ea tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:24.348407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-97eaecca-9344-470b-ab21-306b67f561ea tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:24.495871 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-97eaecca-9344-470b-ab21-306b67f561ea tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:24.503611 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-97eaecca-9344-470b-ab21-306b67f561ea tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.169137 Mar 30 07:19:24.504211 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 248/480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:24 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:25.525082 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ac8d88df-3437-40ab-9194-1f72fa76350b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:25.525968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ac8d88df-3437-40ab-9194-1f72fa76350b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:25.536800 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ac8d88df-3437-40ab-9194-1f72fa76350b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:25.537525 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ac8d88df-3437-40ab-9194-1f72fa76350b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:25.538775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ac8d88df-3437-40ab-9194-1f72fa76350b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:25.539482 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ac8d88df-3437-40ab-9194-1f72fa76350b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:25.682559 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ac8d88df-3437-40ab-9194-1f72fa76350b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:25.692039 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ac8d88df-3437-40ab-9194-1f72fa76350b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.173549 Mar 30 07:19:25.692583 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 233/481] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:25 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:26.708716 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a5010015-fe7b-4aee-bf03-0e18bb961c43 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:26.709293 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a5010015-fe7b-4aee-bf03-0e18bb961c43 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:26.716010 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a5010015-fe7b-4aee-bf03-0e18bb961c43 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:26.716457 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a5010015-fe7b-4aee-bf03-0e18bb961c43 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:26.717211 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a5010015-fe7b-4aee-bf03-0e18bb961c43 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:26.717639 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a5010015-fe7b-4aee-bf03-0e18bb961c43 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:26.866946 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a5010015-fe7b-4aee-bf03-0e18bb961c43 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:26.879032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a5010015-fe7b-4aee-bf03-0e18bb961c43 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.174015 Mar 30 07:19:26.880001 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 249/482] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:26 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:27.900398 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c88b2ed4-bf1d-41c2-8368-3f888c76c5b6 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:27.900984 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c88b2ed4-bf1d-41c2-8368-3f888c76c5b6 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:27.907663 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c88b2ed4-bf1d-41c2-8368-3f888c76c5b6 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:27.908159 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c88b2ed4-bf1d-41c2-8368-3f888c76c5b6 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:27.908905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c88b2ed4-bf1d-41c2-8368-3f888c76c5b6 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:27.909341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c88b2ed4-bf1d-41c2-8368-3f888c76c5b6 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:28.058363 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c88b2ed4-bf1d-41c2-8368-3f888c76c5b6 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:28.066152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c88b2ed4-bf1d-41c2-8368-3f888c76c5b6 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.169723 Mar 30 07:19:28.066723 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 234/483] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:27 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:29.086947 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d3ce883a-b078-4faf-9af0-bf80558c9cf7 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:29.087742 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d3ce883a-b078-4faf-9af0-bf80558c9cf7 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:29.094193 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d3ce883a-b078-4faf-9af0-bf80558c9cf7 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:29.094630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d3ce883a-b078-4faf-9af0-bf80558c9cf7 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:29.095421 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d3ce883a-b078-4faf-9af0-bf80558c9cf7 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:29.095868 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d3ce883a-b078-4faf-9af0-bf80558c9cf7 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:29.235595 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d3ce883a-b078-4faf-9af0-bf80558c9cf7 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:29.243489 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d3ce883a-b078-4faf-9af0-bf80558c9cf7 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.163357 Mar 30 07:19:29.244224 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 250/484] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:29 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:30.260619 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-101b01ce-88a3-420b-9044-ce93831e371e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:30.261252 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-101b01ce-88a3-420b-9044-ce93831e371e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:30.268052 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-101b01ce-88a3-420b-9044-ce93831e371e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:30.268581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-101b01ce-88a3-420b-9044-ce93831e371e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:30.269354 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-101b01ce-88a3-420b-9044-ce93831e371e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:30.269783 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-101b01ce-88a3-420b-9044-ce93831e371e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:30.412617 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-101b01ce-88a3-420b-9044-ce93831e371e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:30.420237 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-101b01ce-88a3-420b-9044-ce93831e371e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.163478 Mar 30 07:19:30.420792 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 235/485] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:30 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:31.438429 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b9aae560-9742-46cf-a4d6-2482bac922b5 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:31.439092 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b9aae560-9742-46cf-a4d6-2482bac922b5 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:31.447635 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b9aae560-9742-46cf-a4d6-2482bac922b5 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:31.448304 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b9aae560-9742-46cf-a4d6-2482bac922b5 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:31.449267 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b9aae560-9742-46cf-a4d6-2482bac922b5 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:31.449993 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b9aae560-9742-46cf-a4d6-2482bac922b5 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:31.680696 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b9aae560-9742-46cf-a4d6-2482bac922b5 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:31.690956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b9aae560-9742-46cf-a4d6-2482bac922b5 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.256974 Mar 30 07:19:31.692022 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 251/486] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:31 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:32.118128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-f0d71e02-1b3f-468a-90fc-fb57dea2b68f req-71bf9ad1-404a-425d-b9ad-3432d87cb963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770fd40-dd13-44c5-a045-2552bc5420dd", "name": "network-vif-plugged", "status": "completed", "tag": "2b0baaac-04a3-4147-9d07-17d4bc9c6c36"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:32.127943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-f0d71e02-1b3f-468a-90fc-fb57dea2b68f req-71bf9ad1-404a-425d-b9ad-3432d87cb963 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:32.128386 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-f0d71e02-1b3f-468a-90fc-fb57dea2b68f req-71bf9ad1-404a-425d-b9ad-3432d87cb963 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:32.142984 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-f0d71e02-1b3f-468a-90fc-fb57dea2b68f req-71bf9ad1-404a-425d-b9ad-3432d87cb963 service nova] Creating event network-vif-plugged:2b0baaac-04a3-4147-9d07-17d4bc9c6c36 for instance 1770fd40-dd13-44c5-a045-2552bc5420dd on hv-cinder-83577 Mar 30 07:19:32.148474 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-f0d71e02-1b3f-468a-90fc-fb57dea2b68f req-71bf9ad1-404a-425d-b9ad-3432d87cb963 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033927 Mar 30 07:19:32.149686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 236/487] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:19:32.708511 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-50cdf3ef-69b8-4d3c-9a9a-608209e669b1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:32.709844 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-50cdf3ef-69b8-4d3c-9a9a-608209e669b1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:32.716582 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-50cdf3ef-69b8-4d3c-9a9a-608209e669b1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:32.717278 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-50cdf3ef-69b8-4d3c-9a9a-608209e669b1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:32.718054 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-50cdf3ef-69b8-4d3c-9a9a-608209e669b1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:32.718538 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-50cdf3ef-69b8-4d3c-9a9a-608209e669b1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:32.856435 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-49b2e7a4-604d-4e79-9846-9bae0f366989 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6e8f7b0-c534-49bb-9e61-d73a6e701de8"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:32.857585 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-49b2e7a4-604d-4e79-9846-9bae0f366989 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:32.864351 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-49b2e7a4-604d-4e79-9846-9bae0f366989 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:32.864976 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-49b2e7a4-604d-4e79-9846-9bae0f366989 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:32.865750 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-49b2e7a4-604d-4e79-9846-9bae0f366989 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:32.866220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-49b2e7a4-604d-4e79-9846-9bae0f366989 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:32.986318 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-50cdf3ef-69b8-4d3c-9a9a-608209e669b1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:32.995404 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-50cdf3ef-69b8-4d3c-9a9a-608209e669b1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.290904 Mar 30 07:19:32.996349 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 252/488] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:32 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:33.335426 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-49b2e7a4-604d-4e79-9846-9bae0f366989 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483711 Mar 30 07:19:33.350002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 237/489] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:19:32 2022] POST /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments => generated 194 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:19:34.012480 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5a6ba849-ed0c-454a-a7c6-b2a5fcb0cab2 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:34.013013 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5a6ba849-ed0c-454a-a7c6-b2a5fcb0cab2 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:34.019232 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a6ba849-ed0c-454a-a7c6-b2a5fcb0cab2 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:34.019699 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a6ba849-ed0c-454a-a7c6-b2a5fcb0cab2 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:34.020514 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a6ba849-ed0c-454a-a7c6-b2a5fcb0cab2 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:34.020939 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a6ba849-ed0c-454a-a7c6-b2a5fcb0cab2 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:34.280321 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5a6ba849-ed0c-454a-a7c6-b2a5fcb0cab2 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:34.289382 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5a6ba849-ed0c-454a-a7c6-b2a5fcb0cab2 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1259 microversion: 2.1 time: 0.280815 Mar 30 07:19:34.290026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 253/490] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:34 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:35.322516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9efa170a-78ba-4cf7-8847-185d3b254115 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:35.326433 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9efa170a-78ba-4cf7-8847-185d3b254115 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:35.335636 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9efa170a-78ba-4cf7-8847-185d3b254115 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:35.336350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9efa170a-78ba-4cf7-8847-185d3b254115 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:35.337482 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9efa170a-78ba-4cf7-8847-185d3b254115 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:35.338244 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9efa170a-78ba-4cf7-8847-185d3b254115 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:35.592264 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9efa170a-78ba-4cf7-8847-185d3b254115 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:35.600424 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9efa170a-78ba-4cf7-8847-185d3b254115 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1444 microversion: 2.1 time: 0.297654 Mar 30 07:19:35.600926 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 238/491] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:35 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1444 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:35.624089 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6d7cd081-fbc2-49ae-acae-ebb0f4d6bfd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:35.624791 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6d7cd081-fbc2-49ae-acae-ebb0f4d6bfd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:35.631990 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6d7cd081-fbc2-49ae-acae-ebb0f4d6bfd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:35.632444 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6d7cd081-fbc2-49ae-acae-ebb0f4d6bfd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:35.633245 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6d7cd081-fbc2-49ae-acae-ebb0f4d6bfd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:35.633668 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6d7cd081-fbc2-49ae-acae-ebb0f4d6bfd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:35.879258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6d7cd081-fbc2-49ae-acae-ebb0f4d6bfd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:35.888651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6d7cd081-fbc2-49ae-acae-ebb0f4d6bfd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1444 microversion: 2.1 time: 0.269271 Mar 30 07:19:35.889572 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 254/492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:35 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1444 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:38.233370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-8f622bd2-e096-4af5-b508-b7beec88846d req-0c030b84-72a6-4f2f-bc4f-1ca961264288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1770fd40-dd13-44c5-a045-2552bc5420dd", "tag": "2b0baaac-04a3-4147-9d07-17d4bc9c6c36"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:38.244188 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-8f622bd2-e096-4af5-b508-b7beec88846d req-0c030b84-72a6-4f2f-bc4f-1ca961264288 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:38.244622 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-8f622bd2-e096-4af5-b508-b7beec88846d req-0c030b84-72a6-4f2f-bc4f-1ca961264288 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:38.259734 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-8f622bd2-e096-4af5-b508-b7beec88846d req-0c030b84-72a6-4f2f-bc4f-1ca961264288 service nova] Creating event network-changed:2b0baaac-04a3-4147-9d07-17d4bc9c6c36 for instance 1770fd40-dd13-44c5-a045-2552bc5420dd on hv-cinder-83577 Mar 30 07:19:38.268760 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-8f622bd2-e096-4af5-b508-b7beec88846d req-0c030b84-72a6-4f2f-bc4f-1ca961264288 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041066 Mar 30 07:19:38.273445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 239/493] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:19:38.496421 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c39cfe51-58e6-442b-992a-e051c66d63c4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:38.497622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c39cfe51-58e6-442b-992a-e051c66d63c4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:38.509529 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c39cfe51-58e6-442b-992a-e051c66d63c4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:38.511351 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c39cfe51-58e6-442b-992a-e051c66d63c4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:38.512403 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c39cfe51-58e6-442b-992a-e051c66d63c4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:38.514505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c39cfe51-58e6-442b-992a-e051c66d63c4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:38.595022 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c39cfe51-58e6-442b-992a-e051c66d63c4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments/99d5af1c-b410-4479-a7be-9396c5a59ddc" status: 200 len: 194 microversion: 2.20 time: 0.097352 Mar 30 07:19:38.596240 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 255/494] 10.222.0.20 () {60 vars in 1453 bytes} [Wed Mar 30 07:19:38 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments/99d5af1c-b410-4479-a7be-9396c5a59ddc => generated 194 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:19:38.699936 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b9d850b6-ff95-43e7-9ad4-817199aa5008 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:38.701462 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b9d850b6-ff95-43e7-9ad4-817199aa5008 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:38.727378 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b9d850b6-ff95-43e7-9ad4-817199aa5008 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:38.730064 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b9d850b6-ff95-43e7-9ad4-817199aa5008 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:38.732441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b9d850b6-ff95-43e7-9ad4-817199aa5008 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:38.733058 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b9d850b6-ff95-43e7-9ad4-817199aa5008 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:38.905437 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-b9d850b6-ff95-43e7-9ad4-817199aa5008 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lazy-loading 'services' on Instance uuid d977a73f-876d-4d10-adf8-326ed77fc467 {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:19:39.051825 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b9d850b6-ff95-43e7-9ad4-817199aa5008 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments/99d5af1c-b410-4479-a7be-9396c5a59ddc" status: 202 len: 0 microversion: 2.20 time: 0.369692 Mar 30 07:19:39.056319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 240/495] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Mar 30 07:19:38 2022] DELETE /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments/99d5af1c-b410-4479-a7be-9396c5a59ddc => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:19:39.061662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b62e9ace-e1c7-4f34-bb14-8a46deb52c65 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:39.062620 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b62e9ace-e1c7-4f34-bb14-8a46deb52c65 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:39.071284 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b62e9ace-e1c7-4f34-bb14-8a46deb52c65 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:39.086648 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b62e9ace-e1c7-4f34-bb14-8a46deb52c65 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:39.088872 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b62e9ace-e1c7-4f34-bb14-8a46deb52c65 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:39.089341 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b62e9ace-e1c7-4f34-bb14-8a46deb52c65 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:39.155981 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b62e9ace-e1c7-4f34-bb14-8a46deb52c65 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098803 Mar 30 07:19:39.157348 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 256/496] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Mar 30 07:19:39 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 30 07:19:40.170553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-dea7de2a-0f39-496d-8011-abdd31dcbec8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:40.171383 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-dea7de2a-0f39-496d-8011-abdd31dcbec8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:40.187587 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dea7de2a-0f39-496d-8011-abdd31dcbec8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:40.188420 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dea7de2a-0f39-496d-8011-abdd31dcbec8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:40.189467 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dea7de2a-0f39-496d-8011-abdd31dcbec8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:40.190269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dea7de2a-0f39-496d-8011-abdd31dcbec8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:40.257078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-dea7de2a-0f39-496d-8011-abdd31dcbec8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090979 Mar 30 07:19:40.257681 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 241/497] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Mar 30 07:19:40 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:19:41.078484 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c4f4aef3-a286-405e-8feb-870f7ccc3cd1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:41.081489 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c4f4aef3-a286-405e-8feb-870f7ccc3cd1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:41.095854 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c4f4aef3-a286-405e-8feb-870f7ccc3cd1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:41.096355 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c4f4aef3-a286-405e-8feb-870f7ccc3cd1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:41.097159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c4f4aef3-a286-405e-8feb-870f7ccc3cd1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:41.097606 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c4f4aef3-a286-405e-8feb-870f7ccc3cd1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:41.164845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-c4f4aef3-a286-405e-8feb-870f7ccc3cd1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lazy-loading 'flavor' on Instance uuid 55662b82-58b5-4206-a411-103fac11b0b2 {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:19:41.270131 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-52d6797c-4ead-40bf-8a59-0998c86d9fcf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:41.271500 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-52d6797c-4ead-40bf-8a59-0998c86d9fcf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:41.277455 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-52d6797c-4ead-40bf-8a59-0998c86d9fcf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:41.287437 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-52d6797c-4ead-40bf-8a59-0998c86d9fcf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:41.289643 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-52d6797c-4ead-40bf-8a59-0998c86d9fcf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:41.290110 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-52d6797c-4ead-40bf-8a59-0998c86d9fcf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:41.408935 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-52d6797c-4ead-40bf-8a59-0998c86d9fcf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143665 Mar 30 07:19:41.409545 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 242/498] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Mar 30 07:19:41 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 30 07:19:41.435950 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c4f4aef3-a286-405e-8feb-870f7ccc3cd1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/action" status: 200 len: 32 microversion: 2.1 time: 0.365165 Mar 30 07:19:41.436833 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 257/499] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:19:41 2022] POST /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/action => generated 32 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 30 07:19:41.446289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-13b968e8-b073-4077-99d4-c41f082c4c7c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:41.447156 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-13b968e8-b073-4077-99d4-c41f082c4c7c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:41.462579 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13b968e8-b073-4077-99d4-c41f082c4c7c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:41.468711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13b968e8-b073-4077-99d4-c41f082c4c7c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:41.470136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13b968e8-b073-4077-99d4-c41f082c4c7c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:41.470786 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-13b968e8-b073-4077-99d4-c41f082c4c7c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:41.741542 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-13b968e8-b073-4077-99d4-c41f082c4c7c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:41.750802 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-13b968e8-b073-4077-99d4-c41f082c4c7c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.308476 Mar 30 07:19:41.752411 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 243/500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:41 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:42.421216 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a0e8cdb2-147a-4e0b-b238-ef4a6edfefc3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:42.422606 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a0e8cdb2-147a-4e0b-b238-ef4a6edfefc3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:42.430296 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a0e8cdb2-147a-4e0b-b238-ef4a6edfefc3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:42.430906 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a0e8cdb2-147a-4e0b-b238-ef4a6edfefc3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:42.431789 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a0e8cdb2-147a-4e0b-b238-ef4a6edfefc3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:42.432376 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a0e8cdb2-147a-4e0b-b238-ef4a6edfefc3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:42.462696 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a0e8cdb2-147a-4e0b-b238-ef4a6edfefc3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045883 Mar 30 07:19:42.463437 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 258/501] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Mar 30 07:19:42 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:42.530220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9997032d-7068-49db-8b06-4f9912fa8f62 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:42.531341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9997032d-7068-49db-8b06-4f9912fa8f62 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:42.538021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9997032d-7068-49db-8b06-4f9912fa8f62 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:42.538716 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9997032d-7068-49db-8b06-4f9912fa8f62 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:42.539495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9997032d-7068-49db-8b06-4f9912fa8f62 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:42.539957 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9997032d-7068-49db-8b06-4f9912fa8f62 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:42.565901 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9997032d-7068-49db-8b06-4f9912fa8f62 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:19:42.662175 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9997032d-7068-49db-8b06-4f9912fa8f62 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 204 len: 0 microversion: 2.20 time: 0.134645 Mar 30 07:19:42.667223 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 244/502] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Mar 30 07:19:42 2022] DELETE /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 30 07:19:42.671499 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:42.672218 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:42.685178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:42.685631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:42.686667 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:42.687186 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:42.773068 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-984f461f-926b-4747-b0d4-8bcbfc39a7c3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:42.773798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-984f461f-926b-4747-b0d4-8bcbfc39a7c3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:42.793361 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-984f461f-926b-4747-b0d4-8bcbfc39a7c3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:42.793804 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-984f461f-926b-4747-b0d4-8bcbfc39a7c3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:42.794843 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-984f461f-926b-4747-b0d4-8bcbfc39a7c3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:42.795073 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-984f461f-926b-4747-b0d4-8bcbfc39a7c3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:42.898731 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:42.907617 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:42.909607 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:42.911141 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7e3269e8-c9b8-46be-ae70-3e4ee5e12dd7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.243607 Mar 30 07:19:42.911703 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 259/503] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:42 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:19:42.977584 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-984f461f-926b-4747-b0d4-8bcbfc39a7c3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:42.986476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-984f461f-926b-4747-b0d4-8bcbfc39a7c3 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.221502 Mar 30 07:19:42.987625 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 245/504] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:42 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:43.250034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b91288da-8204-4753-97b1-f875f079bb24 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Action: 'create', calling method: .version_select at 0x7f154ceb9dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1669774890"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:43.269185 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-b91288da-8204-4753-97b1-f875f079bb24 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for project 803772b9959c49c988cb738b94678917. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:19:43.273164 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-b91288da-8204-4753-97b1-f875f079bb24 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for user 38e427dd29ea4380b01a1c257cc3da00 and project 803772b9959c49c988cb738b94678917. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:19:43.478903 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-b91288da-8204-4753-97b1-f875f079bb24 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for project 803772b9959c49c988cb738b94678917. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:19:43.483392 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-b91288da-8204-4753-97b1-f875f079bb24 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for user 38e427dd29ea4380b01a1c257cc3da00 and project 803772b9959c49c988cb738b94678917. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:19:43.496626 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b91288da-8204-4753-97b1-f875f079bb24 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.415425 Mar 30 07:19:43.497244 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 260/505] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:19:43 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:19:43.930350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:43.931731 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:43.938399 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:43.938839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:43.939746 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:43.940221 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:44.004160 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5735e401-f125-4cfa-8b8c-535a9b2f4bdc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:44.004856 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5735e401-f125-4cfa-8b8c-535a9b2f4bdc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:44.011711 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5735e401-f125-4cfa-8b8c-535a9b2f4bdc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:44.012195 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5735e401-f125-4cfa-8b8c-535a9b2f4bdc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:44.012978 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5735e401-f125-4cfa-8b8c-535a9b2f4bdc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:44.013407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5735e401-f125-4cfa-8b8c-535a9b2f4bdc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:44.155351 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:44.165268 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:44.167073 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:44.168592 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4fc03bc3-bdc5-4d69-936b-355d64aaba46 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.242636 Mar 30 07:19:44.169380 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 246/506] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:43 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:44.200276 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5735e401-f125-4cfa-8b8c-535a9b2f4bdc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:44.208989 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5735e401-f125-4cfa-8b8c-535a9b2f4bdc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.208622 Mar 30 07:19:44.210244 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 261/507] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:43 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:19:45.186748 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:45.188225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:45.202679 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:45.203821 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:45.204866 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:45.205605 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:45.228712 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5eef5d71-c297-4fa7-a35b-17c94fb0c63b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:45.230718 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5eef5d71-c297-4fa7-a35b-17c94fb0c63b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:45.238393 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5eef5d71-c297-4fa7-a35b-17c94fb0c63b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:45.239198 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5eef5d71-c297-4fa7-a35b-17c94fb0c63b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:45.240308 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5eef5d71-c297-4fa7-a35b-17c94fb0c63b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:45.240972 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5eef5d71-c297-4fa7-a35b-17c94fb0c63b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:45.475954 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:45.492166 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:45.497675 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:45.499274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ba26d1b7-4ffb-42ff-81f4-fd23829784d6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1723 microversion: 2.20 time: 0.316571 Mar 30 07:19:45.504356 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 247/508] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:45 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:45.530997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5eef5d71-c297-4fa7-a35b-17c94fb0c63b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:45.544459 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5eef5d71-c297-4fa7-a35b-17c94fb0c63b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.321026 Mar 30 07:19:45.545150 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 262/509] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:45 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:46.180703 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-aa3d6b00-87ab-4db2-be88-89022bfb06fd req-fe1ac26f-c114-4384-b4cd-dbacc4623b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977a73f-876d-4d10-adf8-326ed77fc467", "name": "network-vif-deleted", "tag": "46952506-ed7a-47ba-a4d4-3306605e4824"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:46.201607 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-aa3d6b00-87ab-4db2-be88-89022bfb06fd req-fe1ac26f-c114-4384-b4cd-dbacc4623b26 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:46.202496 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-aa3d6b00-87ab-4db2-be88-89022bfb06fd req-fe1ac26f-c114-4384-b4cd-dbacc4623b26 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:46.233458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-aa3d6b00-87ab-4db2-be88-89022bfb06fd req-fe1ac26f-c114-4384-b4cd-dbacc4623b26 service nova] Creating event network-vif-deleted:46952506-ed7a-47ba-a4d4-3306605e4824 for instance d977a73f-876d-4d10-adf8-326ed77fc467 on hv-cinder-83577 Mar 30 07:19:46.238501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-aa3d6b00-87ab-4db2-be88-89022bfb06fd req-fe1ac26f-c114-4384-b4cd-dbacc4623b26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068687 Mar 30 07:19:46.239099 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 248/510] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:19:46.522688 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:46.523397 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:46.530045 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:46.530535 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:46.531303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:46.531713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:46.563039 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a23f6d15-6406-4252-ba1e-4e38329ba10d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:46.563734 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a23f6d15-6406-4252-ba1e-4e38329ba10d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:46.568922 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:46.569450 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:46.569969 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lazy-loading 'fault' on Instance uuid d977a73f-876d-4d10-adf8-326ed77fc467 {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:19:46.570681 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a23f6d15-6406-4252-ba1e-4e38329ba10d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:46.571129 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a23f6d15-6406-4252-ba1e-4e38329ba10d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:46.572182 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a23f6d15-6406-4252-ba1e-4e38329ba10d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:46.572560 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a23f6d15-6406-4252-ba1e-4e38329ba10d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:46.615784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:46.624184 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:46.626035 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:46.627409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6f9d130d-6445-423b-bf1b-18b5678c152e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 200 len: 1370 microversion: 2.20 time: 0.108849 Mar 30 07:19:46.639943 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 263/511] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:46 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 1370 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:46.734781 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a23f6d15-6406-4252-ba1e-4e38329ba10d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:46.753254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a23f6d15-6406-4252-ba1e-4e38329ba10d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.194349 Mar 30 07:19:46.754737 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 249/512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:46 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:47.646883 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:47.647509 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:47.654278 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:47.654840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:47.655641 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:47.656110 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:47.670084 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] HTTP exception thrown: Instance d977a73f-876d-4d10-adf8-326ed77fc467 could not be found. Mar 30 07:19:47.670678 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Returning 404 to user: Instance d977a73f-876d-4d10-adf8-326ed77fc467 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:19:47.671514 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-da674ed2-222d-43f5-bb50-4405dc632743 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 404 len: 111 microversion: 2.20 time: 0.029314 Mar 30 07:19:47.672103 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 264/513] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:47 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:19:47.680981 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-53da0ae7-82b2-4f85-9fe5-d07005e1e79c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '.version_select at 0x7f153ff0d550>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:47.702343 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-53da0ae7-82b2-4f85-9fe5-d07005e1e79c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897316518" status: 204 len: 0 microversion: 2.20 time: 0.025218 Mar 30 07:19:47.702850 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 250/514] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Mar 30 07:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897316518 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 30 07:19:47.771055 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-8e8191be-900f-4e51-9403-baa1d944b837 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:47.771664 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-8e8191be-900f-4e51-9403-baa1d944b837 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:47.778085 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8e8191be-900f-4e51-9403-baa1d944b837 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:47.778536 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8e8191be-900f-4e51-9403-baa1d944b837 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:47.779303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8e8191be-900f-4e51-9403-baa1d944b837 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:47.779734 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8e8191be-900f-4e51-9403-baa1d944b837 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:47.954472 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-8e8191be-900f-4e51-9403-baa1d944b837 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:47.966702 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-8e8191be-900f-4e51-9403-baa1d944b837 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.199759 Mar 30 07:19:47.967282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 265/515] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:47 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:48.420884 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-38ce40df-4e53-459d-aace-642dd6e0b91e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'create', calling method: .version_select at 0x7f153fe36ca0>, body: {"keypair": {"name": "tempest-keypair-1754541589"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:48.437327 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-38ce40df-4e53-459d-aace-642dd6e0b91e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for project 8ee09b83520e4e8ba691a79d60604388. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:19:48.441963 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-38ce40df-4e53-459d-aace-642dd6e0b91e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for user 93c4c81f994a48feb4d712c6b5120996 and project 8ee09b83520e4e8ba691a79d60604388. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:19:48.764970 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-38ce40df-4e53-459d-aace-642dd6e0b91e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for project 8ee09b83520e4e8ba691a79d60604388. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:19:48.771274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-38ce40df-4e53-459d-aace-642dd6e0b91e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for user 93c4c81f994a48feb4d712c6b5120996 and project 8ee09b83520e4e8ba691a79d60604388. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:19:48.787235 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-38ce40df-4e53-459d-aace-642dd6e0b91e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.370725 Mar 30 07:19:48.788202 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 251/516] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Mar 30 07:19:48 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 372 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Mar 30 07:19:48.985804 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e297769c-4ced-4a06-809b-50795e41ded7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:48.986483 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e297769c-4ced-4a06-809b-50795e41ded7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:48.993174 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e297769c-4ced-4a06-809b-50795e41ded7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:48.993630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e297769c-4ced-4a06-809b-50795e41ded7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:48.994421 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e297769c-4ced-4a06-809b-50795e41ded7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:48.995058 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e297769c-4ced-4a06-809b-50795e41ded7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:49.151731 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e297769c-4ced-4a06-809b-50795e41ded7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:49.160537 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e297769c-4ced-4a06-809b-50795e41ded7 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.178590 Mar 30 07:19:49.163048 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 266/517] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:48 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:50.179966 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-789bb042-4500-4862-b198-18ffea44e74e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:50.180690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-789bb042-4500-4862-b198-18ffea44e74e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:50.186918 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-789bb042-4500-4862-b198-18ffea44e74e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:50.187368 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-789bb042-4500-4862-b198-18ffea44e74e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:50.188164 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-789bb042-4500-4862-b198-18ffea44e74e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:50.188571 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-789bb042-4500-4862-b198-18ffea44e74e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:50.233152 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-773487709", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89db86be-e389-43ed-80e6-11e20145eaf2"}], "security_groups": [{"name": "tempest-securitygroup--1485469750"}], "key_name": "tempest-keypair-1754541589", "user_data": "}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:50.360228 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-789bb042-4500-4862-b198-18ffea44e74e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:50.367604 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] validate_networks() for [('89db86be-e389-43ed-80e6-11e20145eaf2', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:19:50.368362 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-789bb042-4500-4862-b198-18ffea44e74e tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.192801 Mar 30 07:19:50.369256 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 252/518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:50 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:50.752353 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:19:50.752756 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:19:50.753478 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:19:50.754155 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:19:50.754787 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:19:50.764978 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:50.765425 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:50.766232 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:50.766666 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:50.784710 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for project 8ee09b83520e4e8ba691a79d60604388. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:19:50.789299 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Getting quotas for user 93c4c81f994a48feb4d712c6b5120996 and project 8ee09b83520e4e8ba691a79d60604388. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:19:50.802453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:19:50.804796 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:19:50.851384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-47be8c0e-0400-4491-91ee-9c03bab7bc5a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.622859 Mar 30 07:19:50.852071 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 267/519] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Mar 30 07:19:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 30 07:19:50.862842 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d046a441-5ec8-4103-a01d-a915a9a0828b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:50.863538 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d046a441-5ec8-4103-a01d-a915a9a0828b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:50.921020 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d046a441-5ec8-4103-a01d-a915a9a0828b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:50.928449 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d046a441-5ec8-4103-a01d-a915a9a0828b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:50.930030 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d046a441-5ec8-4103-a01d-a915a9a0828b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:50.931109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d046a441-5ec8-4103-a01d-a915a9a0828b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1281 microversion: 2.20 time: 0.072428 Mar 30 07:19:50.938832 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 253/520] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:50 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:51.388093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e6f4c0db-6192-4957-9d83-c07e86c09179 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:51.388983 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e6f4c0db-6192-4957-9d83-c07e86c09179 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:51.403345 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e6f4c0db-6192-4957-9d83-c07e86c09179 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:51.404167 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e6f4c0db-6192-4957-9d83-c07e86c09179 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:51.405824 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e6f4c0db-6192-4957-9d83-c07e86c09179 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:51.406439 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e6f4c0db-6192-4957-9d83-c07e86c09179 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:51.550207 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e6f4c0db-6192-4957-9d83-c07e86c09179 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:51.558258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e6f4c0db-6192-4957-9d83-c07e86c09179 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.175442 Mar 30 07:19:51.558824 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 268/521] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:51 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:51.951339 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:51.952212 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:51.959377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:51.959848 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:51.960636 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:51.961886 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:52.027476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:52.035606 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:52.037429 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:52.038582 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a6e642e6-9ca9-4d72-8203-40237f7a88ad tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1341 microversion: 2.20 time: 0.092528 Mar 30 07:19:52.039352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 254/522] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:51 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1341 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:52.578911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ecc53a50-ab4b-470b-bf2b-8379782795da tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:52.579538 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ecc53a50-ab4b-470b-bf2b-8379782795da tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:52.586871 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ecc53a50-ab4b-470b-bf2b-8379782795da tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:52.587328 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ecc53a50-ab4b-470b-bf2b-8379782795da tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:52.588122 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ecc53a50-ab4b-470b-bf2b-8379782795da tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:52.588557 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ecc53a50-ab4b-470b-bf2b-8379782795da tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:52.748409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ecc53a50-ab4b-470b-bf2b-8379782795da tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:52.757066 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ecc53a50-ab4b-470b-bf2b-8379782795da tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.184480 Mar 30 07:19:52.757800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 269/523] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:52 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:19:53.058147 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:53.058722 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:53.065381 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:53.065922 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:53.066846 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:53.067294 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:53.207516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:53.217414 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:53.218906 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:53.220074 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-773ea9b8-6cad-4d8e-aa98-d644877c6452 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1407 microversion: 2.20 time: 0.165923 Mar 30 07:19:53.220987 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 255/524] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:53 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:53.418282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-4c39cec8-af16-42a3-879e-9fd3d29dc617 req-ecaab024-fd05-439f-b784-8fa382099065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e370a461-4e4d-4b34-87f6-fe6e3ba548b6", "tag": "e4a2a22a-64df-4018-a002-940abcd5bbba"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:53.428523 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-4c39cec8-af16-42a3-879e-9fd3d29dc617 req-ecaab024-fd05-439f-b784-8fa382099065 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:53.429011 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-4c39cec8-af16-42a3-879e-9fd3d29dc617 req-ecaab024-fd05-439f-b784-8fa382099065 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:53.444963 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-4c39cec8-af16-42a3-879e-9fd3d29dc617 req-ecaab024-fd05-439f-b784-8fa382099065 service nova] Creating event network-changed:e4a2a22a-64df-4018-a002-940abcd5bbba for instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 on hv-cinder-83577 Mar 30 07:19:53.450621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-4c39cec8-af16-42a3-879e-9fd3d29dc617 req-ecaab024-fd05-439f-b784-8fa382099065 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036284 Mar 30 07:19:53.451505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 270/525] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:19:53.776501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-93f541d0-4111-49de-8d75-79236e375407 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:53.777591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-93f541d0-4111-49de-8d75-79236e375407 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:53.784460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93f541d0-4111-49de-8d75-79236e375407 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:53.784893 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93f541d0-4111-49de-8d75-79236e375407 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:53.785696 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93f541d0-4111-49de-8d75-79236e375407 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:53.786147 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93f541d0-4111-49de-8d75-79236e375407 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:53.926516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-93f541d0-4111-49de-8d75-79236e375407 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:53.934910 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-93f541d0-4111-49de-8d75-79236e375407 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.163348 Mar 30 07:19:53.935492 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 256/526] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:53 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:54.239394 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:54.240104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:54.246891 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:54.247349 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:54.248161 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:54.248631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:54.384563 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:54.392942 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:54.394826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:54.395962 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-21918447-281e-4bac-a054-3367741c2dfb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1407 microversion: 2.20 time: 0.161029 Mar 30 07:19:54.396515 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 271/527] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:54 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:54.952587 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ce05f9e7-4619-4215-93b5-af9b81d67e8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:54.953171 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ce05f9e7-4619-4215-93b5-af9b81d67e8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:54.959881 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ce05f9e7-4619-4215-93b5-af9b81d67e8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:54.960420 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ce05f9e7-4619-4215-93b5-af9b81d67e8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:54.961198 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ce05f9e7-4619-4215-93b5-af9b81d67e8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:54.961625 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ce05f9e7-4619-4215-93b5-af9b81d67e8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:55.107485 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ce05f9e7-4619-4215-93b5-af9b81d67e8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:55.115820 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ce05f9e7-4619-4215-93b5-af9b81d67e8d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.167110 Mar 30 07:19:55.116365 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 257/528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:54 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:55.417193 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:55.418016 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:55.427583 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:55.428080 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:55.428859 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:55.429289 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:55.568900 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:55.577057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:55.578567 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:55.579675 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-472a0d40-0877-4d08-af6f-f06d62284d7d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1407 microversion: 2.20 time: 0.168611 Mar 30 07:19:55.580280 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 272/529] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:55 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:56.133889 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-17acd419-e2bc-4e8e-aae2-a728cd47f285 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:56.134548 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-17acd419-e2bc-4e8e-aae2-a728cd47f285 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:56.140984 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-17acd419-e2bc-4e8e-aae2-a728cd47f285 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:56.141608 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-17acd419-e2bc-4e8e-aae2-a728cd47f285 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:56.142699 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-17acd419-e2bc-4e8e-aae2-a728cd47f285 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:56.143586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-17acd419-e2bc-4e8e-aae2-a728cd47f285 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:56.284989 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-17acd419-e2bc-4e8e-aae2-a728cd47f285 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:56.293076 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-17acd419-e2bc-4e8e-aae2-a728cd47f285 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.163576 Mar 30 07:19:56.294320 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 258/530] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:56 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:56.601738 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:56.602383 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:56.610984 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:56.611532 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:56.612522 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:56.613058 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:56.760662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:56.768491 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:56.770089 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:56.771255 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-58b26b2d-8af0-4427-8ee9-3c6882752f33 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1407 microversion: 2.20 time: 0.175797 Mar 30 07:19:56.771909 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 273/531] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:56 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:57.317055 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c6acda0f-8446-4a27-823e-e58c7ab65c11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:57.317809 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c6acda0f-8446-4a27-823e-e58c7ab65c11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:57.324724 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c6acda0f-8446-4a27-823e-e58c7ab65c11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:57.325191 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c6acda0f-8446-4a27-823e-e58c7ab65c11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:57.325922 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c6acda0f-8446-4a27-823e-e58c7ab65c11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:57.326350 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c6acda0f-8446-4a27-823e-e58c7ab65c11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:57.463861 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c6acda0f-8446-4a27-823e-e58c7ab65c11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:57.471744 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c6acda0f-8446-4a27-823e-e58c7ab65c11 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.162196 Mar 30 07:19:57.472297 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 259/532] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:57 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:57.789639 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:57.790241 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:57.796449 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:57.796900 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:57.797858 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:57.798279 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:57.942093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:57.951698 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:57.953264 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:57.954377 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3298c162-0c88-45d1-8404-92ad746dab83 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1407 microversion: 2.20 time: 0.169013 Mar 30 07:19:57.954932 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 274/533] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:57 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:58.226581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-b05a1829-99e6-4295-a8e6-31cd885ab8fe req-f60f7e05-ba21-4c7f-9e3c-86b70b930b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e370a461-4e4d-4b34-87f6-fe6e3ba548b6", "name": "network-vif-plugged", "status": "completed", "tag": "e4a2a22a-64df-4018-a002-940abcd5bbba"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:19:58.234969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-b05a1829-99e6-4295-a8e6-31cd885ab8fe req-f60f7e05-ba21-4c7f-9e3c-86b70b930b72 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:58.235411 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-b05a1829-99e6-4295-a8e6-31cd885ab8fe req-f60f7e05-ba21-4c7f-9e3c-86b70b930b72 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:58.246962 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-b05a1829-99e6-4295-a8e6-31cd885ab8fe req-f60f7e05-ba21-4c7f-9e3c-86b70b930b72 service nova] Creating event network-vif-plugged:e4a2a22a-64df-4018-a002-940abcd5bbba for instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 on hv-cinder-83577 Mar 30 07:19:58.251905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-b05a1829-99e6-4295-a8e6-31cd885ab8fe req-f60f7e05-ba21-4c7f-9e3c-86b70b930b72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029364 Mar 30 07:19:58.252543 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 260/534] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:19:58.490190 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b641c4f5-03c5-47d4-99fa-30363660f70a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:58.490647 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b641c4f5-03c5-47d4-99fa-30363660f70a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:58.496822 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b641c4f5-03c5-47d4-99fa-30363660f70a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:58.497271 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b641c4f5-03c5-47d4-99fa-30363660f70a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:58.498049 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b641c4f5-03c5-47d4-99fa-30363660f70a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:58.498502 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b641c4f5-03c5-47d4-99fa-30363660f70a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:58.639301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b641c4f5-03c5-47d4-99fa-30363660f70a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:58.651109 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b641c4f5-03c5-47d4-99fa-30363660f70a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.165153 Mar 30 07:19:58.651852 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 275/535] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:58 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:19:58.978080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:58.979641 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:58.990403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:58.990855 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:58.991629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:58.992095 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:59.144576 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:59.152825 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:59.154337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:19:59.155467 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-741af64d-ad6e-4735-bea7-dc00cc8084cf tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1407 microversion: 2.20 time: 0.185369 Mar 30 07:19:59.156077 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 261/536] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:19:58 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:19:59.668889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7254e715-eb36-4524-a4bc-03ff92cb8559 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:19:59.669619 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7254e715-eb36-4524-a4bc-03ff92cb8559 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:19:59.677174 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7254e715-eb36-4524-a4bc-03ff92cb8559 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:59.677728 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7254e715-eb36-4524-a4bc-03ff92cb8559 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:19:59.678608 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7254e715-eb36-4524-a4bc-03ff92cb8559 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:19:59.679039 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7254e715-eb36-4524-a4bc-03ff92cb8559 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:00.022560 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7254e715-eb36-4524-a4bc-03ff92cb8559 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:00.030555 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7254e715-eb36-4524-a4bc-03ff92cb8559 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.365543 Mar 30 07:20:00.031122 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 276/537] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:19:59 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:00.178138 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:00.179409 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:00.189665 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:00.190449 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:00.191708 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:00.192526 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:00.331207 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:00.339207 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:00.340725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:00.341824 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4f7d19bd-44d1-473c-a0a4-53838d611ecb tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1407 microversion: 2.20 time: 0.170632 Mar 30 07:20:00.342390 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 262/538] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:00 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:01.047535 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-84953f70-021f-450e-912c-adf7a9aeaabd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:01.048167 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-84953f70-021f-450e-912c-adf7a9aeaabd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:01.050405 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1765722720", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1669774890", "security_groups": [{"name": "tempest-secgroup-smoke-1550549607"}], "block_device_mapping_v2": [{"uuid": "41e7b478-9aaa-48c5-975f-32ede8383087", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87604e57-b8c9-45c9-ab61-2b321b1caa0c"}]}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:01.054590 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-84953f70-021f-450e-912c-adf7a9aeaabd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:01.055032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-84953f70-021f-450e-912c-adf7a9aeaabd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:01.055794 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-84953f70-021f-450e-912c-adf7a9aeaabd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:01.056255 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-84953f70-021f-450e-912c-adf7a9aeaabd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:01.183830 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] validate_networks() for [('87604e57-b8c9-45c9-ab61-2b321b1caa0c', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:20:01.284051 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-84953f70-021f-450e-912c-adf7a9aeaabd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:01.295039 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-84953f70-021f-450e-912c-adf7a9aeaabd tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1736 microversion: 2.1 time: 0.250986 Mar 30 07:20:01.295683 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 277/539] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:01 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:01.359845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:01.360462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:01.367028 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:01.367640 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:01.368511 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:01.369080 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:01.618974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:01.627514 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:01.629076 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:01.630241 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d35cc150-e482-46ad-ab72-b8a6abe673ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1600 microversion: 2.20 time: 0.274363 Mar 30 07:20:01.630813 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 278/540] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:01 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1600 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:01.647676 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1007b2bb-d06f-42c8-98d6-f8eb68a20a86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:01.648415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1007b2bb-d06f-42c8-98d6-f8eb68a20a86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:01.653661 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:20:01.654079 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:20:01.654407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1007b2bb-d06f-42c8-98d6-f8eb68a20a86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:01.654564 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:20:01.654833 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1007b2bb-d06f-42c8-98d6-f8eb68a20a86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:01.654986 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:20:01.655334 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:20:01.655594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1007b2bb-d06f-42c8-98d6-f8eb68a20a86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:01.656054 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1007b2bb-d06f-42c8-98d6-f8eb68a20a86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:01.665067 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:01.665635 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:01.666432 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:01.666882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:01.684631 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for project 803772b9959c49c988cb738b94678917. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:20:01.689290 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for user 38e427dd29ea4380b01a1c257cc3da00 and project 803772b9959c49c988cb738b94678917. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:20:01.740938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1007b2bb-d06f-42c8-98d6-f8eb68a20a86 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097043 Mar 30 07:20:01.741604 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 279/541] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Mar 30 07:20:01 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 30 07:20:01.746153 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:20:01.748291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41e7b478-9aaa-48c5-975f-32ede8383087',volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:20:01.875097 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5a0d4b71-5b66-4d04-90a1-0d90fa8bf273 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828543 Mar 30 07:20:01.876109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 263/542] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:20:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 30 07:20:01.886183 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f14fe678-2729-4394-a2ab-c4bfae67ee4c tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:01.887052 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f14fe678-2729-4394-a2ab-c4bfae67ee4c tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:02.005056 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f14fe678-2729-4394-a2ab-c4bfae67ee4c tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:02.016526 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f14fe678-2729-4394-a2ab-c4bfae67ee4c tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1095 microversion: 2.1 time: 0.134376 Mar 30 07:20:02.017341 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 280/543] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:01 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1095 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:02.314098 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2b380093-8113-478c-a059-d4322aeb7b3b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:02.314896 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2b380093-8113-478c-a059-d4322aeb7b3b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:02.322125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2b380093-8113-478c-a059-d4322aeb7b3b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.322676 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2b380093-8113-478c-a059-d4322aeb7b3b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:02.323504 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2b380093-8113-478c-a059-d4322aeb7b3b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.324130 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2b380093-8113-478c-a059-d4322aeb7b3b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:02.555281 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2b380093-8113-478c-a059-d4322aeb7b3b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:02.563237 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2b380093-8113-478c-a059-d4322aeb7b3b tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1716 microversion: 2.1 time: 0.253732 Mar 30 07:20:02.564067 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 264/544] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:02 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1716 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:02.669213 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:02.669878 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:02.676340 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.676791 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:02.677556 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.677985 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:02.758288 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] HTTP exception thrown: Cannot 'detach_volume' instance 55662b82-58b5-4206-a411-103fac11b0b2 while it is in vm_state rescued Mar 30 07:20:02.758870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Returning 409 to user: Cannot 'detach_volume' instance 55662b82-58b5-4206-a411-103fac11b0b2 while it is in vm_state rescued {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:20:02.759724 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-494e13fc-da32-4078-a357-ab8987734300 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "DELETE /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments/e6e8f7b0-c534-49bb-9e61-d73a6e701de8" status: 409 len: 152 microversion: 2.1 time: 0.094584 Mar 30 07:20:02.760470 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 281/545] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:20:02 2022] DELETE /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments/e6e8f7b0-c534-49bb-9e61-d73a6e701de8 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 30 07:20:02.769212 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6806358e-0744-43aa-afd8-82dd4f604643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:02.769809 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6806358e-0744-43aa-afd8-82dd4f604643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:02.776283 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6806358e-0744-43aa-afd8-82dd4f604643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.776734 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6806358e-0744-43aa-afd8-82dd4f604643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:02.777498 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6806358e-0744-43aa-afd8-82dd4f604643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.778093 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6806358e-0744-43aa-afd8-82dd4f604643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:02.814944 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-96b38417-80e9-4acb-990e-d93aa3909752 req-1e4ba544-2229-421e-ab6a-9b543fd74a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e370a461-4e4d-4b34-87f6-fe6e3ba548b6", "tag": "e4a2a22a-64df-4018-a002-940abcd5bbba"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:02.827222 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-96b38417-80e9-4acb-990e-d93aa3909752 req-1e4ba544-2229-421e-ab6a-9b543fd74a6c service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.828509 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-96b38417-80e9-4acb-990e-d93aa3909752 req-1e4ba544-2229-421e-ab6a-9b543fd74a6c service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:02.842841 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-96b38417-80e9-4acb-990e-d93aa3909752 req-1e4ba544-2229-421e-ab6a-9b543fd74a6c service nova] Creating event network-changed:e4a2a22a-64df-4018-a002-940abcd5bbba for instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 on hv-cinder-83577 Mar 30 07:20:02.850431 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-96b38417-80e9-4acb-990e-d93aa3909752 req-1e4ba544-2229-421e-ab6a-9b543fd74a6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039130 Mar 30 07:20:02.851405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 282/546] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:20:02.870415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6806358e-0744-43aa-afd8-82dd4f604643 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "POST /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/action" status: 202 len: 0 microversion: 2.1 time: 0.105194 Mar 30 07:20:02.871061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 265/547] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:20:02 2022] POST /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:20:02.880149 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a92fd35e-d240-4449-80b3-db2d6a9fb413 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:02.880950 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a92fd35e-d240-4449-80b3-db2d6a9fb413 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:02.887586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a92fd35e-d240-4449-80b3-db2d6a9fb413 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.888158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a92fd35e-d240-4449-80b3-db2d6a9fb413 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:02.889377 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a92fd35e-d240-4449-80b3-db2d6a9fb413 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:02.889877 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a92fd35e-d240-4449-80b3-db2d6a9fb413 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:03.037878 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-000cd02a-dc6a-4526-a415-ab43ce04f4a8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:03.040163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-000cd02a-dc6a-4526-a415-ab43ce04f4a8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:03.049797 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-000cd02a-dc6a-4526-a415-ab43ce04f4a8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:03.050676 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-000cd02a-dc6a-4526-a415-ab43ce04f4a8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:03.051662 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-000cd02a-dc6a-4526-a415-ab43ce04f4a8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:03.052309 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-000cd02a-dc6a-4526-a415-ab43ce04f4a8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:03.162638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a92fd35e-d240-4449-80b3-db2d6a9fb413 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:03.175443 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a92fd35e-d240-4449-80b3-db2d6a9fb413 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1724 microversion: 2.1 time: 0.299393 Mar 30 07:20:03.176065 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 283/548] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:02 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:20:03.214574 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-000cd02a-dc6a-4526-a415-ab43ce04f4a8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:03.229550 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-000cd02a-dc6a-4526-a415-ab43ce04f4a8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1201 microversion: 2.1 time: 0.197774 Mar 30 07:20:03.246036 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 266/549] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:03 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1201 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:04.205220 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-92cc1f21-3dd9-424f-9f49-973c62221dfc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:04.206654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-92cc1f21-3dd9-424f-9f49-973c62221dfc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:04.216407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-92cc1f21-3dd9-424f-9f49-973c62221dfc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:04.216929 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-92cc1f21-3dd9-424f-9f49-973c62221dfc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:04.217781 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-92cc1f21-3dd9-424f-9f49-973c62221dfc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:04.218281 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-92cc1f21-3dd9-424f-9f49-973c62221dfc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:04.256158 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7c672f59-3a97-463d-9c24-db3562811991 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:04.258877 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7c672f59-3a97-463d-9c24-db3562811991 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:04.267232 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c672f59-3a97-463d-9c24-db3562811991 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:04.275915 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c672f59-3a97-463d-9c24-db3562811991 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:04.277225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c672f59-3a97-463d-9c24-db3562811991 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:04.277684 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c672f59-3a97-463d-9c24-db3562811991 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:04.364781 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7c672f59-3a97-463d-9c24-db3562811991 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:04.372819 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7c672f59-3a97-463d-9c24-db3562811991 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1199 microversion: 2.1 time: 0.122006 Mar 30 07:20:04.373628 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 267/550] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:04 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1199 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:20:04.402166 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-92cc1f21-3dd9-424f-9f49-973c62221dfc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:04.413429 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-92cc1f21-3dd9-424f-9f49-973c62221dfc tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1724 microversion: 2.1 time: 0.212701 Mar 30 07:20:04.423786 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 284/551] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:04 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:05.175217 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-3a6ac5a1-4605-4c3e-8ae6-8de04c19d4e2 req-681cf2cc-7f54-43c8-b0b9-a80b9e0602d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a76b506-9c23-4b23-a6e2-7c35a67f853b", "tag": "911e3e03-0ad9-43ce-ac95-4b86be14605b"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:05.188675 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-3a6ac5a1-4605-4c3e-8ae6-8de04c19d4e2 req-681cf2cc-7f54-43c8-b0b9-a80b9e0602d0 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:05.189147 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-3a6ac5a1-4605-4c3e-8ae6-8de04c19d4e2 req-681cf2cc-7f54-43c8-b0b9-a80b9e0602d0 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:05.206341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-3a6ac5a1-4605-4c3e-8ae6-8de04c19d4e2 req-681cf2cc-7f54-43c8-b0b9-a80b9e0602d0 service nova] Creating event network-changed:911e3e03-0ad9-43ce-ac95-4b86be14605b for instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b on hv-cinder-83577 Mar 30 07:20:05.214947 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-3a6ac5a1-4605-4c3e-8ae6-8de04c19d4e2 req-681cf2cc-7f54-43c8-b0b9-a80b9e0602d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043565 Mar 30 07:20:05.215799 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 268/552] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:05.389949 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9f611cfb-66d8-431b-a272-8ba973e05e22 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:05.390566 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9f611cfb-66d8-431b-a272-8ba973e05e22 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:05.406240 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9f611cfb-66d8-431b-a272-8ba973e05e22 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:05.406953 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9f611cfb-66d8-431b-a272-8ba973e05e22 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:05.407731 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9f611cfb-66d8-431b-a272-8ba973e05e22 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:05.408451 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9f611cfb-66d8-431b-a272-8ba973e05e22 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:05.431463 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7102470a-1a4b-4e2d-9c54-a1c7977fbadb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:05.432303 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7102470a-1a4b-4e2d-9c54-a1c7977fbadb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:05.439435 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7102470a-1a4b-4e2d-9c54-a1c7977fbadb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:05.440026 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7102470a-1a4b-4e2d-9c54-a1c7977fbadb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:05.440874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7102470a-1a4b-4e2d-9c54-a1c7977fbadb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:05.441375 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7102470a-1a4b-4e2d-9c54-a1c7977fbadb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:05.601234 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9f611cfb-66d8-431b-a272-8ba973e05e22 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:05.609869 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9f611cfb-66d8-431b-a272-8ba973e05e22 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.223874 Mar 30 07:20:05.610420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 285/553] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:05 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:05.627241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7102470a-1a4b-4e2d-9c54-a1c7977fbadb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:05.636580 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7102470a-1a4b-4e2d-9c54-a1c7977fbadb tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1724 microversion: 2.1 time: 0.209692 Mar 30 07:20:05.637424 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 269/554] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:05 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:06.633642 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-28a62c2b-0a76-481e-983a-4ebe2b37e6c3 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:06.634664 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-28a62c2b-0a76-481e-983a-4ebe2b37e6c3 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:06.645558 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-28a62c2b-0a76-481e-983a-4ebe2b37e6c3 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:06.646331 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-28a62c2b-0a76-481e-983a-4ebe2b37e6c3 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:06.647716 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-28a62c2b-0a76-481e-983a-4ebe2b37e6c3 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:06.648196 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-28a62c2b-0a76-481e-983a-4ebe2b37e6c3 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:06.655796 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f49cd2dd-6a0b-4b68-91a1-a01160205b73 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:06.656562 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f49cd2dd-6a0b-4b68-91a1-a01160205b73 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:06.663285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f49cd2dd-6a0b-4b68-91a1-a01160205b73 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:06.663967 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f49cd2dd-6a0b-4b68-91a1-a01160205b73 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:06.664959 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f49cd2dd-6a0b-4b68-91a1-a01160205b73 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:06.665978 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f49cd2dd-6a0b-4b68-91a1-a01160205b73 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:06.853316 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-28a62c2b-0a76-481e-983a-4ebe2b37e6c3 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:06.857535 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f49cd2dd-6a0b-4b68-91a1-a01160205b73 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:06.861230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-28a62c2b-0a76-481e-983a-4ebe2b37e6c3 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.234307 Mar 30 07:20:06.861801 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 286/555] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:06 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:06.865706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f49cd2dd-6a0b-4b68-91a1-a01160205b73 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1730 microversion: 2.1 time: 0.213743 Mar 30 07:20:06.866313 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 270/556] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:06 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:06.884048 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-72a26afa-9cdf-46f4-bd97-544a13f6fc5f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:06.884445 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-72a26afa-9cdf-46f4-bd97-544a13f6fc5f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:06.890468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72a26afa-9cdf-46f4-bd97-544a13f6fc5f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:06.890919 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72a26afa-9cdf-46f4-bd97-544a13f6fc5f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:06.891674 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72a26afa-9cdf-46f4-bd97-544a13f6fc5f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:06.892127 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-72a26afa-9cdf-46f4-bd97-544a13f6fc5f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:06.990350 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-72a26afa-9cdf-46f4-bd97-544a13f6fc5f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111563 Mar 30 07:20:06.991105 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 287/557] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Mar 30 07:20:06 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:07.878344 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9c452f2e-f556-4586-b2fd-bb9d2d3ad9e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:07.878886 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9c452f2e-f556-4586-b2fd-bb9d2d3ad9e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:07.885403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9c452f2e-f556-4586-b2fd-bb9d2d3ad9e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:07.885821 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9c452f2e-f556-4586-b2fd-bb9d2d3ad9e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:07.886623 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9c452f2e-f556-4586-b2fd-bb9d2d3ad9e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:07.887053 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9c452f2e-f556-4586-b2fd-bb9d2d3ad9e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:07.985538 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-0a891905-84c4-4c59-84f7-0856df5cfbc9 req-0f114e1a-6cd2-4d3b-a804-99be38841564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55662b82-58b5-4206-a411-103fac11b0b2", "tag": "c73621da-1c9c-4d35-9b39-2038b6ae4204"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:07.995497 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-0a891905-84c4-4c59-84f7-0856df5cfbc9 req-0f114e1a-6cd2-4d3b-a804-99be38841564 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:07.996323 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-0a891905-84c4-4c59-84f7-0856df5cfbc9 req-0f114e1a-6cd2-4d3b-a804-99be38841564 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:08.019758 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-0a891905-84c4-4c59-84f7-0856df5cfbc9 req-0f114e1a-6cd2-4d3b-a804-99be38841564 service nova] Creating event network-changed:c73621da-1c9c-4d35-9b39-2038b6ae4204 for instance 55662b82-58b5-4206-a411-103fac11b0b2 on hv-cinder-83577 Mar 30 07:20:08.025748 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-0a891905-84c4-4c59-84f7-0856df5cfbc9 req-0f114e1a-6cd2-4d3b-a804-99be38841564 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044238 Mar 30 07:20:08.026757 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 288/558] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:20:08.032942 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9c452f2e-f556-4586-b2fd-bb9d2d3ad9e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:08.042329 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9c452f2e-f556-4586-b2fd-bb9d2d3ad9e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.167970 Mar 30 07:20:08.042919 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 271/559] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:07 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:09.064585 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2aa92bd3-3cc5-4577-8f7f-d74f41330691 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:09.065720 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2aa92bd3-3cc5-4577-8f7f-d74f41330691 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:09.076122 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2aa92bd3-3cc5-4577-8f7f-d74f41330691 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:09.076569 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2aa92bd3-3cc5-4577-8f7f-d74f41330691 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:09.077342 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2aa92bd3-3cc5-4577-8f7f-d74f41330691 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:09.077789 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2aa92bd3-3cc5-4577-8f7f-d74f41330691 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:09.227926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2aa92bd3-3cc5-4577-8f7f-d74f41330691 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:09.236369 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2aa92bd3-3cc5-4577-8f7f-d74f41330691 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.179746 Mar 30 07:20:09.236911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 289/560] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:09 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:10.044543 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-7c12236e-b6c2-41a7-8f92-71fbb558bca0 req-1ae133e4-339a-433d-a3e5-f5ccd621642f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55662b82-58b5-4206-a411-103fac11b0b2", "tag": "c73621da-1c9c-4d35-9b39-2038b6ae4204"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:10.054055 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7c12236e-b6c2-41a7-8f92-71fbb558bca0 req-1ae133e4-339a-433d-a3e5-f5ccd621642f service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:10.054723 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7c12236e-b6c2-41a7-8f92-71fbb558bca0 req-1ae133e4-339a-433d-a3e5-f5ccd621642f service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:10.066822 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-7c12236e-b6c2-41a7-8f92-71fbb558bca0 req-1ae133e4-339a-433d-a3e5-f5ccd621642f service nova] Creating event network-changed:c73621da-1c9c-4d35-9b39-2038b6ae4204 for instance 55662b82-58b5-4206-a411-103fac11b0b2 on hv-cinder-83577 Mar 30 07:20:10.072725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-7c12236e-b6c2-41a7-8f92-71fbb558bca0 req-1ae133e4-339a-433d-a3e5-f5ccd621642f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Mar 30 07:20:10.073493 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 272/561] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:10.253742 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4c115f65-f319-4912-b19a-cd238d8ddbb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:10.255002 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4c115f65-f319-4912-b19a-cd238d8ddbb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:10.261585 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4c115f65-f319-4912-b19a-cd238d8ddbb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:10.262240 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4c115f65-f319-4912-b19a-cd238d8ddbb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:10.263233 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4c115f65-f319-4912-b19a-cd238d8ddbb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:10.263667 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4c115f65-f319-4912-b19a-cd238d8ddbb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:10.404633 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4c115f65-f319-4912-b19a-cd238d8ddbb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:10.412159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4c115f65-f319-4912-b19a-cd238d8ddbb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.162312 Mar 30 07:20:10.412907 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 290/562] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:10 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:11.435865 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-afb00052-ac56-4f32-9e80-25677cfb7c97 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:11.436996 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-afb00052-ac56-4f32-9e80-25677cfb7c97 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:11.447095 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-afb00052-ac56-4f32-9e80-25677cfb7c97 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:11.447540 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-afb00052-ac56-4f32-9e80-25677cfb7c97 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:11.448330 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-afb00052-ac56-4f32-9e80-25677cfb7c97 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:11.448783 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-afb00052-ac56-4f32-9e80-25677cfb7c97 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:11.600192 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-afb00052-ac56-4f32-9e80-25677cfb7c97 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:11.608175 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-afb00052-ac56-4f32-9e80-25677cfb7c97 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.180762 Mar 30 07:20:11.608758 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 273/563] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:11 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:12.626594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-18b3af22-48ab-4159-8773-c9f7e9bf1cb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:12.627261 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-18b3af22-48ab-4159-8773-c9f7e9bf1cb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:12.635007 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-18b3af22-48ab-4159-8773-c9f7e9bf1cb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:12.635498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-18b3af22-48ab-4159-8773-c9f7e9bf1cb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:12.636395 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-18b3af22-48ab-4159-8773-c9f7e9bf1cb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:12.636870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-18b3af22-48ab-4159-8773-c9f7e9bf1cb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:12.784711 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-18b3af22-48ab-4159-8773-c9f7e9bf1cb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:12.792294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-18b3af22-48ab-4159-8773-c9f7e9bf1cb1 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.170003 Mar 30 07:20:12.792900 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 291/564] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:12 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:13.813820 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1c30dfb6-339a-4a9a-ab5b-5a7f6b12fdb6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:13.814786 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1c30dfb6-339a-4a9a-ab5b-5a7f6b12fdb6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:13.824244 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1c30dfb6-339a-4a9a-ab5b-5a7f6b12fdb6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:13.824683 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1c30dfb6-339a-4a9a-ab5b-5a7f6b12fdb6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:13.825477 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1c30dfb6-339a-4a9a-ab5b-5a7f6b12fdb6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:13.825901 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1c30dfb6-339a-4a9a-ab5b-5a7f6b12fdb6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:13.982593 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1c30dfb6-339a-4a9a-ab5b-5a7f6b12fdb6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:13.991952 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1c30dfb6-339a-4a9a-ab5b-5a7f6b12fdb6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.184536 Mar 30 07:20:13.992530 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 274/565] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:13 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:14.348855 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-2b839ed1-5665-490e-a0bd-5461484b013d req-78c11ae5-1980-4c71-8bc8-4b9e9c0413d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a76b506-9c23-4b23-a6e2-7c35a67f853b", "name": "network-vif-plugged", "status": "completed", "tag": "911e3e03-0ad9-43ce-ac95-4b86be14605b"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:14.358386 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-2b839ed1-5665-490e-a0bd-5461484b013d req-78c11ae5-1980-4c71-8bc8-4b9e9c0413d1 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:14.358835 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-2b839ed1-5665-490e-a0bd-5461484b013d req-78c11ae5-1980-4c71-8bc8-4b9e9c0413d1 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:14.370298 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-2b839ed1-5665-490e-a0bd-5461484b013d req-78c11ae5-1980-4c71-8bc8-4b9e9c0413d1 service nova] Creating event network-vif-plugged:911e3e03-0ad9-43ce-ac95-4b86be14605b for instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b on hv-cinder-83577 Mar 30 07:20:14.375223 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-2b839ed1-5665-490e-a0bd-5461484b013d req-78c11ae5-1980-4c71-8bc8-4b9e9c0413d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030216 Mar 30 07:20:14.375840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 292/566] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:15.011655 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-31f96600-0cfe-43e1-9919-21ea82bbe537 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:15.012274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-31f96600-0cfe-43e1-9919-21ea82bbe537 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:15.019163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31f96600-0cfe-43e1-9919-21ea82bbe537 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:15.019615 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31f96600-0cfe-43e1-9919-21ea82bbe537 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:15.020497 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31f96600-0cfe-43e1-9919-21ea82bbe537 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:15.020990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31f96600-0cfe-43e1-9919-21ea82bbe537 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:15.178341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-31f96600-0cfe-43e1-9919-21ea82bbe537 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:15.190346 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-31f96600-0cfe-43e1-9919-21ea82bbe537 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1267 microversion: 2.1 time: 0.184206 Mar 30 07:20:15.191158 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 275/567] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:15 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:16.209006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-34d2fc84-40cc-4228-a1ec-fbc46d192396 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:16.209959 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-34d2fc84-40cc-4228-a1ec-fbc46d192396 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:16.217701 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-34d2fc84-40cc-4228-a1ec-fbc46d192396 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:16.218205 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-34d2fc84-40cc-4228-a1ec-fbc46d192396 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:16.218971 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-34d2fc84-40cc-4228-a1ec-fbc46d192396 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:16.219402 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-34d2fc84-40cc-4228-a1ec-fbc46d192396 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:16.366212 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-34d2fc84-40cc-4228-a1ec-fbc46d192396 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:16.374523 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-34d2fc84-40cc-4228-a1ec-fbc46d192396 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1454 microversion: 2.1 time: 0.169944 Mar 30 07:20:16.375093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 293/568] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:16 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:16.393756 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7bb5db2d-747b-4975-9b4c-581606af2f55 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:16.394725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7bb5db2d-747b-4975-9b4c-581606af2f55 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:16.403201 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7bb5db2d-747b-4975-9b4c-581606af2f55 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:16.403643 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7bb5db2d-747b-4975-9b4c-581606af2f55 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:16.404509 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7bb5db2d-747b-4975-9b4c-581606af2f55 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:16.404934 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7bb5db2d-747b-4975-9b4c-581606af2f55 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:16.542383 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7bb5db2d-747b-4975-9b4c-581606af2f55 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:16.550514 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7bb5db2d-747b-4975-9b4c-581606af2f55 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1454 microversion: 2.1 time: 0.163202 Mar 30 07:20:16.551057 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 276/569] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:16 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:18.669847 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-ce96b315-aa54-4805-8bf8-6da5e9ac888a req-e537510a-bf35-4b3e-b98c-f63e620db3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a76b506-9c23-4b23-a6e2-7c35a67f853b", "tag": "911e3e03-0ad9-43ce-ac95-4b86be14605b"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:18.679986 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-ce96b315-aa54-4805-8bf8-6da5e9ac888a req-e537510a-bf35-4b3e-b98c-f63e620db3e7 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:18.680574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-ce96b315-aa54-4805-8bf8-6da5e9ac888a req-e537510a-bf35-4b3e-b98c-f63e620db3e7 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:18.696957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-ce96b315-aa54-4805-8bf8-6da5e9ac888a req-e537510a-bf35-4b3e-b98c-f63e620db3e7 service nova] Creating event network-changed:911e3e03-0ad9-43ce-ac95-4b86be14605b for instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b on hv-cinder-83577 Mar 30 07:20:18.702983 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-ce96b315-aa54-4805-8bf8-6da5e9ac888a req-e537510a-bf35-4b3e-b98c-f63e620db3e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038680 Mar 30 07:20:18.703701 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 294/570] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:25.049711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-56d3e976-ee76-4d25-a74e-a588d01d89c3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:25.050653 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-56d3e976-ee76-4d25-a74e-a588d01d89c3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:25.057708 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-56d3e976-ee76-4d25-a74e-a588d01d89c3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:25.058155 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-56d3e976-ee76-4d25-a74e-a588d01d89c3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:25.058916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-56d3e976-ee76-4d25-a74e-a588d01d89c3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:25.059345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-56d3e976-ee76-4d25-a74e-a588d01d89c3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:25.089437 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-56d3e976-ee76-4d25-a74e-a588d01d89c3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043663 Mar 30 07:20:25.090003 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 277/571] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:20:25 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:20:25.150056 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-cb9d6641-0dab-4544-8827-422db3c643ae tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:25.150630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-cb9d6641-0dab-4544-8827-422db3c643ae tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:25.157088 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb9d6641-0dab-4544-8827-422db3c643ae tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:25.157542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb9d6641-0dab-4544-8827-422db3c643ae tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:25.158310 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb9d6641-0dab-4544-8827-422db3c643ae tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:25.158741 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb9d6641-0dab-4544-8827-422db3c643ae tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:25.182418 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-cb9d6641-0dab-4544-8827-422db3c643ae tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:20:25.263938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-cb9d6641-0dab-4544-8827-422db3c643ae tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 204 len: 0 microversion: 2.1 time: 0.118464 Mar 30 07:20:25.264581 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 295/572] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:20:25 2022] DELETE /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:20:25.275047 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0dd2a466-6f15-4646-8cd2-ded69f3724c4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:25.275617 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0dd2a466-6f15-4646-8cd2-ded69f3724c4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:25.282303 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0dd2a466-6f15-4646-8cd2-ded69f3724c4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:25.282844 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0dd2a466-6f15-4646-8cd2-ded69f3724c4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:25.283686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0dd2a466-6f15-4646-8cd2-ded69f3724c4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:25.284241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0dd2a466-6f15-4646-8cd2-ded69f3724c4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:25.431754 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0dd2a466-6f15-4646-8cd2-ded69f3724c4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:25.439934 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0dd2a466-6f15-4646-8cd2-ded69f3724c4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1675 microversion: 2.1 time: 0.170645 Mar 30 07:20:25.440518 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 278/573] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:25 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:20:26.458327 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-78268251-1056-46be-b7ea-194ce752ce01 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:26.459025 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-78268251-1056-46be-b7ea-194ce752ce01 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:26.465940 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-78268251-1056-46be-b7ea-194ce752ce01 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:26.466389 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-78268251-1056-46be-b7ea-194ce752ce01 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:26.467157 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-78268251-1056-46be-b7ea-194ce752ce01 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:26.467587 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-78268251-1056-46be-b7ea-194ce752ce01 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:26.607586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-78268251-1056-46be-b7ea-194ce752ce01 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:26.615088 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-78268251-1056-46be-b7ea-194ce752ce01 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1675 microversion: 2.1 time: 0.161050 Mar 30 07:20:26.615657 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 296/574] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:26 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:27.636294 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-192751cd-7ea1-4782-a82c-98152993ba45 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:27.636893 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-192751cd-7ea1-4782-a82c-98152993ba45 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:27.643662 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-192751cd-7ea1-4782-a82c-98152993ba45 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:27.644136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-192751cd-7ea1-4782-a82c-98152993ba45 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:27.644877 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-192751cd-7ea1-4782-a82c-98152993ba45 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:27.645322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-192751cd-7ea1-4782-a82c-98152993ba45 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:27.789953 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-192751cd-7ea1-4782-a82c-98152993ba45 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:27.798043 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-192751cd-7ea1-4782-a82c-98152993ba45 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1675 microversion: 2.1 time: 0.167837 Mar 30 07:20:27.798606 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 279/575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:27 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:28.607838 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-ecb2237a-04cc-40bd-a28b-dacf4fdf74b5 req-5044f55a-8ede-4711-a9f4-f2780f56a37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea531783-864c-44f2-9311-d1939a112f2b", "name": "network-vif-deleted", "tag": "cc0a9d6a-7177-46dd-b56e-afefa52539b0"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:28.616364 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-ecb2237a-04cc-40bd-a28b-dacf4fdf74b5 req-5044f55a-8ede-4711-a9f4-f2780f56a37d service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:28.616810 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-ecb2237a-04cc-40bd-a28b-dacf4fdf74b5 req-5044f55a-8ede-4711-a9f4-f2780f56a37d service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:28.628944 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-ecb2237a-04cc-40bd-a28b-dacf4fdf74b5 req-5044f55a-8ede-4711-a9f4-f2780f56a37d service nova] Creating event network-vif-deleted:cc0a9d6a-7177-46dd-b56e-afefa52539b0 for instance ea531783-864c-44f2-9311-d1939a112f2b on hv-cinder-83577 Mar 30 07:20:28.634012 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-ecb2237a-04cc-40bd-a28b-dacf4fdf74b5 req-5044f55a-8ede-4711-a9f4-f2780f56a37d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030838 Mar 30 07:20:28.635188 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 297/576] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:28.816225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:28.816842 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:28.823173 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:28.823621 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:28.824426 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:28.824858 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:28.857978 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:28.858428 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:28.858876 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lazy-loading 'fault' on Instance uuid ea531783-864c-44f2-9311-d1939a112f2b {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:20:28.904811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:28.912538 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-447c7406-46cf-4085-ac20-6e7ee7d853c6 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 200 len: 1328 microversion: 2.1 time: 0.100333 Mar 30 07:20:28.913026 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 280/577] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:28 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:29.931056 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:29.931617 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:29.938400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:29.938872 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:29.939641 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:29.940468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:29.953833 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] HTTP exception thrown: Instance ea531783-864c-44f2-9311-d1939a112f2b could not be found. Mar 30 07:20:29.954415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Returning 404 to user: Instance ea531783-864c-44f2-9311-d1939a112f2b could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:20:29.955228 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0bf2d1d7-c6db-4244-9e30-9b90a4d7c6ad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 404 len: 111 microversion: 2.1 time: 0.029066 Mar 30 07:20:29.955764 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 298/578] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:29 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:20:29.966894 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-091f162a-3c06-4c8a-aa4d-85c83ce55354 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '.version_select at 0x7f153fdd93a0>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:29.993220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-091f162a-3c06-4c8a-aa4d-85c83ce55354 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484575127" status: 202 len: 0 microversion: 2.1 time: 0.031972 Mar 30 07:20:29.994043 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 281/579] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Mar 30 07:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484575127 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:20:30.683477 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-25cfac9a-36f4-43e6-a012-a7d8a9806353 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'create', calling method: .version_select at 0x7f154ceb95e0>, body: {"keypair": {"name": "tempest-keypair-1503434125"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:30.699672 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-25cfac9a-36f4-43e6-a012-a7d8a9806353 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for project cc9ab7163ff443ff849d017d40115708. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:20:30.706075 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-25cfac9a-36f4-43e6-a012-a7d8a9806353 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for user 8dd9d32c47014294a367654b57c96f3f and project cc9ab7163ff443ff849d017d40115708. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:20:31.172145 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-25cfac9a-36f4-43e6-a012-a7d8a9806353 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for project cc9ab7163ff443ff849d017d40115708. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:20:31.175769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-25cfac9a-36f4-43e6-a012-a7d8a9806353 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for user 8dd9d32c47014294a367654b57c96f3f and project cc9ab7163ff443ff849d017d40115708. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:20:31.188628 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-25cfac9a-36f4-43e6-a012-a7d8a9806353 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.509645 Mar 30 07:20:31.189225 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 299/580] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:20:30 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:32.605520 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1306227994", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdc48dd9-ac72-4ec1-96d3-56de9895320a"}], "security_groups": [{"name": "tempest-securitygroup--586700796"}], "key_name": "tempest-keypair-1503434125", "user_data": "}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:32.852948 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] validate_networks() for [('fdc48dd9-ac72-4ec1-96d3-56de9895320a', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:20:33.245048 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:20:33.245473 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:20:33.245937 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:20:33.246338 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:20:33.246737 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:20:33.256504 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:33.256940 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:33.257728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:33.258152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:33.277445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for project cc9ab7163ff443ff849d017d40115708. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:20:33.281868 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Getting quotas for user 8dd9d32c47014294a367654b57c96f3f and project cc9ab7163ff443ff849d017d40115708. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:20:33.294490 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:20:33.296780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:20:33.348844 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9740b987-17ba-410e-98ec-1058b1455036 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.748594 Mar 30 07:20:33.349493 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 282/581] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:20:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:20:33.360926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-611a1960-e7cb-4894-9c77-992bdcfd6622 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:33.361546 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-611a1960-e7cb-4894-9c77-992bdcfd6622 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:33.468495 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-611a1960-e7cb-4894-9c77-992bdcfd6622 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:33.476217 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-611a1960-e7cb-4894-9c77-992bdcfd6622 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1238 microversion: 2.1 time: 0.119922 Mar 30 07:20:33.476858 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 300/582] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:33 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:34.494506 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-198c42ea-9f64-43a5-af6c-b51f88d2024a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:34.495173 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-198c42ea-9f64-43a5-af6c-b51f88d2024a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:34.502296 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-198c42ea-9f64-43a5-af6c-b51f88d2024a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:34.502756 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-198c42ea-9f64-43a5-af6c-b51f88d2024a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:34.503525 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-198c42ea-9f64-43a5-af6c-b51f88d2024a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:34.504139 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-198c42ea-9f64-43a5-af6c-b51f88d2024a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:34.568944 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-198c42ea-9f64-43a5-af6c-b51f88d2024a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:34.576815 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-198c42ea-9f64-43a5-af6c-b51f88d2024a tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1308 microversion: 2.1 time: 0.086617 Mar 30 07:20:34.577430 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 283/583] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:34 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1308 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:35.593968 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-002e97ea-d957-4ee5-bcf4-5f91a221ba34 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:35.595802 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-002e97ea-d957-4ee5-bcf4-5f91a221ba34 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:35.604211 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-002e97ea-d957-4ee5-bcf4-5f91a221ba34 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:35.604653 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-002e97ea-d957-4ee5-bcf4-5f91a221ba34 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:35.605456 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-002e97ea-d957-4ee5-bcf4-5f91a221ba34 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:35.605889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-002e97ea-d957-4ee5-bcf4-5f91a221ba34 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:35.757822 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-002e97ea-d957-4ee5-bcf4-5f91a221ba34 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:35.766161 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-002e97ea-d957-4ee5-bcf4-5f91a221ba34 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1363 microversion: 2.1 time: 0.176801 Mar 30 07:20:35.767015 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 301/584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:35 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:35.846344 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-ede58fa8-269f-4a77-9c12-de84adf77c0c req-f6231b9e-9ca0-4809-a12a-191cc7178317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14430ed1-6f8f-4808-81fa-ac17c639f964", "tag": "7cd6bbda-aa42-4eaa-819e-1d240a300263"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:35.855520 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-ede58fa8-269f-4a77-9c12-de84adf77c0c req-f6231b9e-9ca0-4809-a12a-191cc7178317 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:35.856068 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-ede58fa8-269f-4a77-9c12-de84adf77c0c req-f6231b9e-9ca0-4809-a12a-191cc7178317 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:35.875253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-ede58fa8-269f-4a77-9c12-de84adf77c0c req-f6231b9e-9ca0-4809-a12a-191cc7178317 service nova] Creating event network-changed:7cd6bbda-aa42-4eaa-819e-1d240a300263 for instance 14430ed1-6f8f-4808-81fa-ac17c639f964 on hv-cinder-83577 Mar 30 07:20:35.880781 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-ede58fa8-269f-4a77-9c12-de84adf77c0c req-f6231b9e-9ca0-4809-a12a-191cc7178317 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038250 Mar 30 07:20:35.881383 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 284/585] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:36.783957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-da79d8b2-0f9f-4d43-b4b7-20bfd4871ea8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:36.784540 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-da79d8b2-0f9f-4d43-b4b7-20bfd4871ea8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:36.790935 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da79d8b2-0f9f-4d43-b4b7-20bfd4871ea8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:36.791380 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da79d8b2-0f9f-4d43-b4b7-20bfd4871ea8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:36.792157 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da79d8b2-0f9f-4d43-b4b7-20bfd4871ea8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:36.792600 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-da79d8b2-0f9f-4d43-b4b7-20bfd4871ea8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:36.944608 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-da79d8b2-0f9f-4d43-b4b7-20bfd4871ea8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:36.953365 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-da79d8b2-0f9f-4d43-b4b7-20bfd4871ea8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1363 microversion: 2.1 time: 0.173241 Mar 30 07:20:36.953948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 302/586] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:36 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:37.975501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-60853466-706f-41ff-ac3b-3a7cc774b2e8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:37.976685 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-60853466-706f-41ff-ac3b-3a7cc774b2e8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:37.988249 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-60853466-706f-41ff-ac3b-3a7cc774b2e8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:37.988985 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-60853466-706f-41ff-ac3b-3a7cc774b2e8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:37.990233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-60853466-706f-41ff-ac3b-3a7cc774b2e8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:37.990947 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-60853466-706f-41ff-ac3b-3a7cc774b2e8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:38.132495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-60853466-706f-41ff-ac3b-3a7cc774b2e8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:38.141752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-60853466-706f-41ff-ac3b-3a7cc774b2e8 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1363 microversion: 2.1 time: 0.173371 Mar 30 07:20:38.142334 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 285/587] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:37 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:39.159024 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1e2160c5-87b0-4cb5-8537-6d514f8e4b7f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:39.159614 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1e2160c5-87b0-4cb5-8537-6d514f8e4b7f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:39.166462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e2160c5-87b0-4cb5-8537-6d514f8e4b7f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:39.166913 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e2160c5-87b0-4cb5-8537-6d514f8e4b7f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:39.167688 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e2160c5-87b0-4cb5-8537-6d514f8e4b7f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:39.168163 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e2160c5-87b0-4cb5-8537-6d514f8e4b7f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:39.318412 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1e2160c5-87b0-4cb5-8537-6d514f8e4b7f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:39.327447 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1e2160c5-87b0-4cb5-8537-6d514f8e4b7f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1363 microversion: 2.1 time: 0.172334 Mar 30 07:20:39.328030 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 303/588] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:39 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:40.353835 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fb3ff31a-08fc-472e-843e-b67cd1e38445 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:40.354833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-fb3ff31a-08fc-472e-843e-b67cd1e38445 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:40.362605 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fb3ff31a-08fc-472e-843e-b67cd1e38445 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:40.363037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fb3ff31a-08fc-472e-843e-b67cd1e38445 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:40.363800 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fb3ff31a-08fc-472e-843e-b67cd1e38445 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:40.364258 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fb3ff31a-08fc-472e-843e-b67cd1e38445 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:40.497379 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fb3ff31a-08fc-472e-843e-b67cd1e38445 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:40.505984 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fb3ff31a-08fc-472e-843e-b67cd1e38445 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1363 microversion: 2.1 time: 0.158928 Mar 30 07:20:40.506543 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 286/589] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:40 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:40.517296 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-dba7bb15-325d-419d-ba08-fd3d1a50f597 req-d99c83e3-47fc-4969-93c6-6c26f909f1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14430ed1-6f8f-4808-81fa-ac17c639f964", "name": "network-vif-plugged", "status": "completed", "tag": "7cd6bbda-aa42-4eaa-819e-1d240a300263"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:40.526282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-dba7bb15-325d-419d-ba08-fd3d1a50f597 req-d99c83e3-47fc-4969-93c6-6c26f909f1f3 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:40.526721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-dba7bb15-325d-419d-ba08-fd3d1a50f597 req-d99c83e3-47fc-4969-93c6-6c26f909f1f3 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:40.538368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-dba7bb15-325d-419d-ba08-fd3d1a50f597 req-d99c83e3-47fc-4969-93c6-6c26f909f1f3 service nova] Creating event network-vif-plugged:7cd6bbda-aa42-4eaa-819e-1d240a300263 for instance 14430ed1-6f8f-4808-81fa-ac17c639f964 on hv-cinder-83577 Mar 30 07:20:40.543294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-dba7bb15-325d-419d-ba08-fd3d1a50f597 req-d99c83e3-47fc-4969-93c6-6c26f909f1f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029868 Mar 30 07:20:40.543882 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 304/590] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:41.527137 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5a5ece65-5ae6-4d72-8e91-74255bebb368 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:41.528019 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5a5ece65-5ae6-4d72-8e91-74255bebb368 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:41.535389 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a5ece65-5ae6-4d72-8e91-74255bebb368 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:41.535833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a5ece65-5ae6-4d72-8e91-74255bebb368 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:41.536634 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a5ece65-5ae6-4d72-8e91-74255bebb368 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:41.537073 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a5ece65-5ae6-4d72-8e91-74255bebb368 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:41.683591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5a5ece65-5ae6-4d72-8e91-74255bebb368 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:41.692176 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5a5ece65-5ae6-4d72-8e91-74255bebb368 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1363 microversion: 2.1 time: 0.171896 Mar 30 07:20:41.693030 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 287/591] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:41 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:42.767919 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4924cc30-b053-47a3-98c0-906933ec3a12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:42.768597 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4924cc30-b053-47a3-98c0-906933ec3a12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:42.775312 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4924cc30-b053-47a3-98c0-906933ec3a12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:42.775757 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4924cc30-b053-47a3-98c0-906933ec3a12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:42.776557 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4924cc30-b053-47a3-98c0-906933ec3a12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:42.777042 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4924cc30-b053-47a3-98c0-906933ec3a12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:42.927345 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4924cc30-b053-47a3-98c0-906933ec3a12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:42.935318 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4924cc30-b053-47a3-98c0-906933ec3a12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1549 microversion: 2.1 time: 0.228650 Mar 30 07:20:42.935920 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 305/592] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:42 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:42.952066 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-35a8b132-004c-453c-9b44-ebfca3b659cf tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:42.952594 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-35a8b132-004c-453c-9b44-ebfca3b659cf tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:42.959183 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-35a8b132-004c-453c-9b44-ebfca3b659cf tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:42.959638 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-35a8b132-004c-453c-9b44-ebfca3b659cf tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:42.960446 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-35a8b132-004c-453c-9b44-ebfca3b659cf tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:42.960882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-35a8b132-004c-453c-9b44-ebfca3b659cf tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:43.049590 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-35a8b132-004c-453c-9b44-ebfca3b659cf tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101089 Mar 30 07:20:43.050433 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 288/593] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Mar 30 07:20:42 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:44.251128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-39eb38aa-0a47-4043-bc9b-82a4af1b8a43 req-9f1b42a4-0b71-461e-824e-54a5920994ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14430ed1-6f8f-4808-81fa-ac17c639f964", "tag": "7cd6bbda-aa42-4eaa-819e-1d240a300263"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:44.259605 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-39eb38aa-0a47-4043-bc9b-82a4af1b8a43 req-9f1b42a4-0b71-461e-824e-54a5920994ed service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:44.260072 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-39eb38aa-0a47-4043-bc9b-82a4af1b8a43 req-9f1b42a4-0b71-461e-824e-54a5920994ed service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:44.271403 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-39eb38aa-0a47-4043-bc9b-82a4af1b8a43 req-9f1b42a4-0b71-461e-824e-54a5920994ed service nova] Creating event network-changed:7cd6bbda-aa42-4eaa-819e-1d240a300263 for instance 14430ed1-6f8f-4808-81fa-ac17c639f964 on hv-cinder-83577 Mar 30 07:20:44.276390 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-39eb38aa-0a47-4043-bc9b-82a4af1b8a43 req-9f1b42a4-0b71-461e-824e-54a5920994ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029288 Mar 30 07:20:44.277192 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 306/594] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:46.199766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ad775a64-9e45-45a9-be7c-1bf1a0b8892d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:46.200341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ad775a64-9e45-45a9-be7c-1bf1a0b8892d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:46.206781 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ad775a64-9e45-45a9-be7c-1bf1a0b8892d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:46.207222 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ad775a64-9e45-45a9-be7c-1bf1a0b8892d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:46.208027 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ad775a64-9e45-45a9-be7c-1bf1a0b8892d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:46.208461 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ad775a64-9e45-45a9-be7c-1bf1a0b8892d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:46.289746 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-ad775a64-9e45-45a9-be7c-1bf1a0b8892d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lazy-loading 'services' on Instance uuid 55662b82-58b5-4206-a411-103fac11b0b2 {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:20:46.370826 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ad775a64-9e45-45a9-be7c-1bf1a0b8892d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "DELETE /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments/e6e8f7b0-c534-49bb-9e61-d73a6e701de8" status: 202 len: 0 microversion: 2.1 time: 0.175007 Mar 30 07:20:46.371590 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 289/595] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:20:46 2022] DELETE /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments/e6e8f7b0-c534-49bb-9e61-d73a6e701de8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:20:46.381916 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-09da91be-ad55-4c62-889f-60e90d741fb9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:46.383006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-09da91be-ad55-4c62-889f-60e90d741fb9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:46.390218 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-09da91be-ad55-4c62-889f-60e90d741fb9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:46.391038 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-09da91be-ad55-4c62-889f-60e90d741fb9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:46.392322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-09da91be-ad55-4c62-889f-60e90d741fb9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:46.393066 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-09da91be-ad55-4c62-889f-60e90d741fb9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:46.431032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-09da91be-ad55-4c62-889f-60e90d741fb9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054590 Mar 30 07:20:46.431600 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 307/596] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:20:46 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:46.847910 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cd44f3e7-4ad0-491b-b70f-0239c619b60d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:46.848479 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cd44f3e7-4ad0-491b-b70f-0239c619b60d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:46.855208 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cd44f3e7-4ad0-491b-b70f-0239c619b60d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:46.855651 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cd44f3e7-4ad0-491b-b70f-0239c619b60d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:46.856450 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cd44f3e7-4ad0-491b-b70f-0239c619b60d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:46.856884 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cd44f3e7-4ad0-491b-b70f-0239c619b60d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:46.880738 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cd44f3e7-4ad0-491b-b70f-0239c619b60d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/ips" status: 200 len: 153 microversion: 2.20 time: 0.099072 Mar 30 07:20:46.881319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 290/597] 10.222.0.20 () {60 vars in 1288 bytes} [Wed Mar 30 07:20:46 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/ips => generated 153 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:20:47.444063 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-8263bbed-21f2-43d7-aded-902b38be5312 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:47.444993 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-8263bbed-21f2-43d7-aded-902b38be5312 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:47.451475 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8263bbed-21f2-43d7-aded-902b38be5312 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:47.451966 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8263bbed-21f2-43d7-aded-902b38be5312 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:47.452731 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8263bbed-21f2-43d7-aded-902b38be5312 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:47.453150 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8263bbed-21f2-43d7-aded-902b38be5312 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:47.481919 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-8263bbed-21f2-43d7-aded-902b38be5312 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041953 Mar 30 07:20:47.482475 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 308/598] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:20:47 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:48.498411 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-89a66e0b-c4af-4825-aa16-43a2afcd96b4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:48.500028 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-89a66e0b-c4af-4825-aa16-43a2afcd96b4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:48.506868 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-89a66e0b-c4af-4825-aa16-43a2afcd96b4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:48.507313 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-89a66e0b-c4af-4825-aa16-43a2afcd96b4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:48.508129 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-89a66e0b-c4af-4825-aa16-43a2afcd96b4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:48.508564 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-89a66e0b-c4af-4825-aa16-43a2afcd96b4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:48.538040 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-89a66e0b-c4af-4825-aa16-43a2afcd96b4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046585 Mar 30 07:20:48.538591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 291/599] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:20:48 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:20:48.610988 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b16106a7-07fd-4c42-b3ff-42b01ae73ae1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:48.611557 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b16106a7-07fd-4c42-b3ff-42b01ae73ae1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:48.618243 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b16106a7-07fd-4c42-b3ff-42b01ae73ae1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:48.618696 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b16106a7-07fd-4c42-b3ff-42b01ae73ae1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:48.619471 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b16106a7-07fd-4c42-b3ff-42b01ae73ae1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:48.619955 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b16106a7-07fd-4c42-b3ff-42b01ae73ae1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:48.644398 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b16106a7-07fd-4c42-b3ff-42b01ae73ae1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:20:48.732951 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b16106a7-07fd-4c42-b3ff-42b01ae73ae1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "DELETE /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 204 len: 0 microversion: 2.1 time: 0.125566 Mar 30 07:20:48.733536 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 309/600] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:20:48 2022] DELETE /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:20:48.742078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b4893ce0-3b52-4e4a-b8ea-c33c33307572 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:48.742686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b4893ce0-3b52-4e4a-b8ea-c33c33307572 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:48.748941 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4893ce0-3b52-4e4a-b8ea-c33c33307572 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:48.749277 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4893ce0-3b52-4e4a-b8ea-c33c33307572 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:48.750061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4893ce0-3b52-4e4a-b8ea-c33c33307572 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:48.750487 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4893ce0-3b52-4e4a-b8ea-c33c33307572 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:48.771651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-37ebf332-b70a-4c76-b226-ec9fab458344 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:48.772383 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-37ebf332-b70a-4c76-b226-ec9fab458344 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:48.778441 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-37ebf332-b70a-4c76-b226-ec9fab458344 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:48.778889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-37ebf332-b70a-4c76-b226-ec9fab458344 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:48.779646 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-37ebf332-b70a-4c76-b226-ec9fab458344 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:48.780106 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-37ebf332-b70a-4c76-b226-ec9fab458344 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:48.802753 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-37ebf332-b70a-4c76-b226-ec9fab458344 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lazy-loading 'flavor' on Instance uuid e370a461-4e4d-4b34-87f6-fe6e3ba548b6 {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:20:48.892408 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b4893ce0-3b52-4e4a-b8ea-c33c33307572 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:48.900072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b4893ce0-3b52-4e4a-b8ea-c33c33307572 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1690 microversion: 2.1 time: 0.161998 Mar 30 07:20:48.900679 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 292/601] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:48 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:49.063917 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-37ebf332-b70a-4c76-b226-ec9fab458344 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/action" status: 202 len: 0 microversion: 2.20 time: 0.296304 Mar 30 07:20:49.064551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 310/602] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Mar 30 07:20:48 2022] POST /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:20:49.072740 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:49.073633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:49.080611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:49.081094 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:49.082125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:49.082597 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:49.222748 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:49.231246 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:49.232762 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:49.233913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-637d25e8-4732-42d3-94be-0cbde57d5bb1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.165103 Mar 30 07:20:49.234504 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 293/603] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:49 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:49.922810 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-deda2a74-44db-4814-a2b9-5bb3c7301399 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:49.924034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-deda2a74-44db-4814-a2b9-5bb3c7301399 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:49.934993 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-deda2a74-44db-4814-a2b9-5bb3c7301399 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:49.935738 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-deda2a74-44db-4814-a2b9-5bb3c7301399 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:49.937062 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-deda2a74-44db-4814-a2b9-5bb3c7301399 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:49.937879 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-deda2a74-44db-4814-a2b9-5bb3c7301399 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:50.087542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-deda2a74-44db-4814-a2b9-5bb3c7301399 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:50.099450 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-deda2a74-44db-4814-a2b9-5bb3c7301399 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1690 microversion: 2.1 time: 0.184452 Mar 30 07:20:50.100319 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 311/604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:49 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:50.253470 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:50.254072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:50.260846 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:50.261290 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:50.262053 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:50.262483 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:50.415495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:50.425419 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:50.426921 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:50.428121 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fc9350f6-95a0-4ece-8d51-82ca8cbc58ba tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.178898 Mar 30 07:20:50.428718 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 294/605] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:50 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:51.120173 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ff10fd06-fe49-4dde-862f-4880b90d1473 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:51.120796 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ff10fd06-fe49-4dde-862f-4880b90d1473 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:51.128264 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ff10fd06-fe49-4dde-862f-4880b90d1473 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:51.128715 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ff10fd06-fe49-4dde-862f-4880b90d1473 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:51.129483 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ff10fd06-fe49-4dde-862f-4880b90d1473 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:51.129915 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ff10fd06-fe49-4dde-862f-4880b90d1473 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:51.275165 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-ff10fd06-fe49-4dde-862f-4880b90d1473 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:51.283116 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ff10fd06-fe49-4dde-862f-4880b90d1473 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1690 microversion: 2.1 time: 0.167794 Mar 30 07:20:51.283709 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 312/606] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:51 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:51.451249 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:51.452691 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:51.462975 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:51.463673 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:51.465016 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:51.465722 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:51.609298 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:51.617339 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:51.618849 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:51.620045 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-213b4585-651d-4b1f-8966-46a292e53569 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.175542 Mar 30 07:20:51.620610 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 295/607] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:51 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:52.304298 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d0d05b7f-1ac4-455d-90c6-fbfe67f4a4b1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:52.305370 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d0d05b7f-1ac4-455d-90c6-fbfe67f4a4b1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:52.315997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d0d05b7f-1ac4-455d-90c6-fbfe67f4a4b1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:52.316743 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d0d05b7f-1ac4-455d-90c6-fbfe67f4a4b1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:52.318003 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d0d05b7f-1ac4-455d-90c6-fbfe67f4a4b1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:52.318715 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d0d05b7f-1ac4-455d-90c6-fbfe67f4a4b1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:52.458895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d0d05b7f-1ac4-455d-90c6-fbfe67f4a4b1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:52.466733 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d0d05b7f-1ac4-455d-90c6-fbfe67f4a4b1 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1690 microversion: 2.1 time: 0.168862 Mar 30 07:20:52.467333 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 313/608] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:52 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:52.638385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:52.638988 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:52.646009 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:52.646459 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:52.647226 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:52.647658 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:52.783619 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:52.791728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:52.793276 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:52.794460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2707153c-da9f-489d-a9cd-e63932d6b321 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.160040 Mar 30 07:20:52.795033 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 296/609] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:52 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:53.438251 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-e46d279a-7570-4a7e-b0fe-a51a8fae4a21 req-dcb98110-20fb-44cf-bfb6-10e0acd872a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55662b82-58b5-4206-a411-103fac11b0b2", "name": "network-vif-deleted", "tag": "c73621da-1c9c-4d35-9b39-2038b6ae4204"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:20:53.449131 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-e46d279a-7570-4a7e-b0fe-a51a8fae4a21 req-dcb98110-20fb-44cf-bfb6-10e0acd872a9 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:53.449575 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-e46d279a-7570-4a7e-b0fe-a51a8fae4a21 req-dcb98110-20fb-44cf-bfb6-10e0acd872a9 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:53.465238 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-e46d279a-7570-4a7e-b0fe-a51a8fae4a21 req-dcb98110-20fb-44cf-bfb6-10e0acd872a9 service nova] Creating event network-vif-deleted:c73621da-1c9c-4d35-9b39-2038b6ae4204 for instance 55662b82-58b5-4206-a411-103fac11b0b2 on hv-cinder-83577 Mar 30 07:20:53.472168 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-e46d279a-7570-4a7e-b0fe-a51a8fae4a21 req-dcb98110-20fb-44cf-bfb6-10e0acd872a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037234 Mar 30 07:20:53.474014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 314/610] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:20:53.485117 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-70cb56db-c301-4bb7-a4a8-362eac8acaf2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:53.485743 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-70cb56db-c301-4bb7-a4a8-362eac8acaf2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:53.492102 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-70cb56db-c301-4bb7-a4a8-362eac8acaf2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:53.492512 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-70cb56db-c301-4bb7-a4a8-362eac8acaf2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:53.493287 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-70cb56db-c301-4bb7-a4a8-362eac8acaf2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:53.493792 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-70cb56db-c301-4bb7-a4a8-362eac8acaf2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:53.585985 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-70cb56db-c301-4bb7-a4a8-362eac8acaf2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:53.595562 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-70cb56db-c301-4bb7-a4a8-362eac8acaf2 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 200 len: 1330 microversion: 2.1 time: 0.114860 Mar 30 07:20:53.596190 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 297/611] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:53 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:20:53.815632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:53.816407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:53.822849 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:53.823329 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:53.824139 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:53.824574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:53.961177 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:53.970408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:53.972116 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:53.973280 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c22e1685-4e13-4383-84d8-025edfc373d1 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.162377 Mar 30 07:20:53.973836 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 315/612] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:53 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:54.612981 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:54.613613 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 55662b82-58b5-4206-a411-103fac11b0b2] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:54.620500 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:54.621037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:54.621881 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:54.622370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:54.638120 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] HTTP exception thrown: Instance 55662b82-58b5-4206-a411-103fac11b0b2 could not be found. Mar 30 07:20:54.638731 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Returning 404 to user: Instance 55662b82-58b5-4206-a411-103fac11b0b2 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:20:54.639765 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a5cd9cc5-9dc4-4ef7-a150-ab3b68ff3e5a tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2" status: 404 len: 111 microversion: 2.1 time: 0.030819 Mar 30 07:20:54.640450 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 298/613] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:54 2022] GET /compute/v2.1/servers/55662b82-58b5-4206-a411-103fac11b0b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:20:54.649057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b7a149b0-3470-49e7-a537-940c2c9c7cd4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '.version_select at 0x7f154c5d24c0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:54.668718 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b7a149b0-3470-49e7-a537-940c2c9c7cd4 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418839186" status: 202 len: 0 microversion: 2.1 time: 0.023396 Mar 30 07:20:54.669299 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 316/614] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Mar 30 07:20:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418839186 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:20:54.992403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:54.993013 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:54.999131 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:54.999655 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:55.000526 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:55.000969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:55.226480 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:55.235650 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:55.237222 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:55.238465 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b575ad6f-2e22-4bc3-ac94-815598fd8290 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.250262 Mar 30 07:20:55.239080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 299/615] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:54 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:56.260034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:56.260648 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:56.269558 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:56.270012 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:56.270835 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:56.271303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:56.420418 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:56.428956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:56.430475 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:56.432298 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7023f03f-5fc0-44c2-930f-94aeec79c4e0 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.178733 Mar 30 07:20:56.433492 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 317/616] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:56 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:57.450063 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:57.450662 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:57.457937 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:57.458385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:57.459196 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:57.459633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:57.604579 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:57.613154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:57.614646 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:57.615824 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-04654e0f-8906-472f-a041-e04e33738c8d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.169690 Mar 30 07:20:57.616367 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 300/617] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:57 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:57.672136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-8f4d4202-a681-4005-8565-a26492550213 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:57.672666 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-8f4d4202-a681-4005-8565-a26492550213 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:57.679296 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8f4d4202-a681-4005-8565-a26492550213 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:57.679746 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8f4d4202-a681-4005-8565-a26492550213 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:57.680543 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8f4d4202-a681-4005-8565-a26492550213 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:57.680970 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8f4d4202-a681-4005-8565-a26492550213 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:57.706363 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-8f4d4202-a681-4005-8565-a26492550213 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:20:57.793959 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-8f4d4202-a681-4005-8565-a26492550213 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 204 len: 0 microversion: 2.1 time: 0.127809 Mar 30 07:20:57.794791 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 318/618] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:20:57 2022] DELETE /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:20:57.805510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f4788980-b45a-4b6a-a672-e5556010050d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:57.806130 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f4788980-b45a-4b6a-a672-e5556010050d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:57.812429 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f4788980-b45a-4b6a-a672-e5556010050d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:57.812864 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f4788980-b45a-4b6a-a672-e5556010050d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:57.813838 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f4788980-b45a-4b6a-a672-e5556010050d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:57.814845 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f4788980-b45a-4b6a-a672-e5556010050d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:57.968243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f4788980-b45a-4b6a-a672-e5556010050d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:57.976454 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f4788980-b45a-4b6a-a672-e5556010050d tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1507 microversion: 2.1 time: 0.176235 Mar 30 07:20:57.977333 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 301/619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:57 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:58.639437 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:58.640628 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:58.651085 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:58.651875 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:58.653165 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:58.653891 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:58.798690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:58.807615 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:58.809146 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:58.810318 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3d6698f9-f9ae-4d6f-8a8a-fb0881a11c95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.178214 Mar 30 07:20:58.810895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 319/620] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:58 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:20:58.998780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5da5fe8b-aa95-4471-ab5a-5afdaf4877b9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:58.999776 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5da5fe8b-aa95-4471-ab5a-5afdaf4877b9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:59.010544 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5da5fe8b-aa95-4471-ab5a-5afdaf4877b9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:59.011279 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5da5fe8b-aa95-4471-ab5a-5afdaf4877b9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:59.012630 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5da5fe8b-aa95-4471-ab5a-5afdaf4877b9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:59.013359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5da5fe8b-aa95-4471-ab5a-5afdaf4877b9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:59.165685 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5da5fe8b-aa95-4471-ab5a-5afdaf4877b9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:20:59.173253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5da5fe8b-aa95-4471-ab5a-5afdaf4877b9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1507 microversion: 2.1 time: 0.181285 Mar 30 07:20:59.173815 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 302/621] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:20:58 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:20:59.832522 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:20:59.833374 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:20:59.842507 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:59.842953 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:59.843728 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:20:59.844183 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:20:59.994363 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:00.006422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:00.008997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:00.011230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-346a2764-2f0d-4d10-bd55-909cbf3c2b95 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.184842 Mar 30 07:21:00.012287 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 320/622] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:20:59 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:00.191075 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-08860896-8ddf-44f7-83ec-ce72a89676f8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:00.191833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-08860896-8ddf-44f7-83ec-ce72a89676f8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:00.198626 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-08860896-8ddf-44f7-83ec-ce72a89676f8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:00.199078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-08860896-8ddf-44f7-83ec-ce72a89676f8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:00.199840 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-08860896-8ddf-44f7-83ec-ce72a89676f8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:00.200319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-08860896-8ddf-44f7-83ec-ce72a89676f8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:00.341195 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-08860896-8ddf-44f7-83ec-ce72a89676f8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:00.349505 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-08860896-8ddf-44f7-83ec-ce72a89676f8 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1507 microversion: 2.1 time: 0.162645 Mar 30 07:21:00.350080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 303/623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:00 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:01.025852 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-8b8114fa-8426-42fe-9aeb-944a8937ac48 req-1c53dadd-7d49-4996-8494-b124747c5af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d831174-317c-4c6d-b5b7-e01974621585", "name": "network-vif-deleted", "tag": "2143af28-585c-4f87-adef-e00385fa7b91"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:01.035153 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:01.036285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:01.036546 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-8b8114fa-8426-42fe-9aeb-944a8937ac48 req-1c53dadd-7d49-4996-8494-b124747c5af7 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:01.036996 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-8b8114fa-8426-42fe-9aeb-944a8937ac48 req-1c53dadd-7d49-4996-8494-b124747c5af7 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:01.043649 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:01.044548 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:01.045800 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:01.046458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:01.048638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-8b8114fa-8426-42fe-9aeb-944a8937ac48 req-1c53dadd-7d49-4996-8494-b124747c5af7 service nova] Creating event network-vif-deleted:2143af28-585c-4f87-adef-e00385fa7b91 for instance 1d831174-317c-4c6d-b5b7-e01974621585 on hv-cinder-83577 Mar 30 07:21:01.053875 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-8b8114fa-8426-42fe-9aeb-944a8937ac48 req-1c53dadd-7d49-4996-8494-b124747c5af7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089597 Mar 30 07:21:01.058740 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 321/624] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:01.191273 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:01.203885 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:01.205450 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:01.207042 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-201f78e2-dbce-4715-9021-64759a29fed3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.177489 Mar 30 07:21:01.207930 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 304/625] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:01 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:01.367547 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:01.368867 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:01.376146 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:01.376588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:01.377366 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:01.377792 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:01.408633 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:01.409076 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:01.410024 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lazy-loading 'fault' on Instance uuid 1d831174-317c-4c6d-b5b7-e01974621585 {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:21:01.457829 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:01.465344 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-372b0d88-afbc-4812-a38e-43a17e9ec046 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 200 len: 1311 microversion: 2.1 time: 0.102111 Mar 30 07:21:01.465902 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 322/626] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:01 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:02.229600 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:02.230713 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:02.240173 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:02.240621 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:02.241385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:02.241818 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:02.377843 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:02.386039 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:02.387517 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:02.388741 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1e3b5901-68bb-40e2-ba92-9bf81269d427 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.166052 Mar 30 07:21:02.389308 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 305/627] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:02 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:02.487507 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:02.488911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 1d831174-317c-4c6d-b5b7-e01974621585] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:02.500045 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:02.500801 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:02.502084 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:02.502818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:02.517022 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] HTTP exception thrown: Instance 1d831174-317c-4c6d-b5b7-e01974621585 could not be found. Mar 30 07:21:02.517619 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Returning 404 to user: Instance 1d831174-317c-4c6d-b5b7-e01974621585 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:21:02.518526 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9eed4b3e-96aa-4cd4-a63b-97bdb914910c tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585" status: 404 len: 111 microversion: 2.1 time: 0.037814 Mar 30 07:21:02.519112 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 323/628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:02 2022] GET /compute/v2.1/servers/1d831174-317c-4c6d-b5b7-e01974621585 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:02.528657 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-75635dcf-3ce3-43ee-b6fd-78630ad00985 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:02.529152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-75635dcf-3ce3-43ee-b6fd-78630ad00985 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:02.536255 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75635dcf-3ce3-43ee-b6fd-78630ad00985 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:02.536703 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75635dcf-3ce3-43ee-b6fd-78630ad00985 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:02.537469 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75635dcf-3ce3-43ee-b6fd-78630ad00985 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:02.537902 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75635dcf-3ce3-43ee-b6fd-78630ad00985 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:02.563331 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-75635dcf-3ce3-43ee-b6fd-78630ad00985 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:21:02.643319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-75635dcf-3ce3-43ee-b6fd-78630ad00985 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 204 len: 0 microversion: 2.1 time: 0.118289 Mar 30 07:21:02.644238 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 306/629] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:21:02 2022] DELETE /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:21:02.655033 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-68345f51-e837-4ba8-a635-ecdb71f92498 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:02.655964 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-68345f51-e837-4ba8-a635-ecdb71f92498 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:02.662841 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68345f51-e837-4ba8-a635-ecdb71f92498 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:02.663291 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68345f51-e837-4ba8-a635-ecdb71f92498 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:02.664092 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68345f51-e837-4ba8-a635-ecdb71f92498 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:02.664525 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68345f51-e837-4ba8-a635-ecdb71f92498 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:02.816430 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-68345f51-e837-4ba8-a635-ecdb71f92498 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:02.824525 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-68345f51-e837-4ba8-a635-ecdb71f92498 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.175737 Mar 30 07:21:02.825099 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 324/630] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:02 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:03.412029 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:03.412811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:03.419833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:03.420305 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:03.421059 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:03.421489 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:03.562948 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:03.575879 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:03.578224 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:03.579932 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b4fea92f-37fa-4e0a-badc-83e0a1c644b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.175211 Mar 30 07:21:03.580706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 307/631] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:03 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:03.846281 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-fe610d8a-87ff-4a28-b573-7e239dcdf6bf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:03.847476 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-fe610d8a-87ff-4a28-b573-7e239dcdf6bf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:03.854959 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fe610d8a-87ff-4a28-b573-7e239dcdf6bf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:03.855437 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fe610d8a-87ff-4a28-b573-7e239dcdf6bf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:03.856325 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fe610d8a-87ff-4a28-b573-7e239dcdf6bf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:03.856785 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-fe610d8a-87ff-4a28-b573-7e239dcdf6bf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:04.005764 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-fe610d8a-87ff-4a28-b573-7e239dcdf6bf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:04.013197 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-fe610d8a-87ff-4a28-b573-7e239dcdf6bf tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.173549 Mar 30 07:21:04.013758 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 325/632] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:03 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:04.606166 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:04.606743 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:04.614607 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:04.615046 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:04.615833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:04.616274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:04.758501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:04.770838 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:04.773109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:04.774769 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-dc1c37f6-34d6-446b-9ce2-dfb2ea0fcc82 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1746 microversion: 2.20 time: 0.173036 Mar 30 07:21:04.775546 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 308/633] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:04 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:05.035032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-234b8184-321e-4469-9160-0e371ba9911f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:05.036016 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-234b8184-321e-4469-9160-0e371ba9911f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:05.046630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-234b8184-321e-4469-9160-0e371ba9911f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:05.047368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-234b8184-321e-4469-9160-0e371ba9911f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:05.048726 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-234b8184-321e-4469-9160-0e371ba9911f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:05.049447 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-234b8184-321e-4469-9160-0e371ba9911f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:05.187839 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-234b8184-321e-4469-9160-0e371ba9911f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:05.196035 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-234b8184-321e-4469-9160-0e371ba9911f tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.167810 Mar 30 07:21:05.196588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 326/634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:05 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:05.800170 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:05.801000 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:05.807599 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:05.808096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:05.808856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:05.809292 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:05.954924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:05.963544 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:05.965675 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:05.967050 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-786a6ad1-ceef-4497-a68d-b62ace37b774 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1746 microversion: 2.20 time: 0.174839 Mar 30 07:21:05.967601 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 309/635] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:05 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:06.212916 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-842e4fcd-773d-48b4-a227-f590df65fc62 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:06.213526 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-842e4fcd-773d-48b4-a227-f590df65fc62 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:06.220104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-842e4fcd-773d-48b4-a227-f590df65fc62 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:06.220551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-842e4fcd-773d-48b4-a227-f590df65fc62 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:06.221334 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-842e4fcd-773d-48b4-a227-f590df65fc62 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:06.221905 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-842e4fcd-773d-48b4-a227-f590df65fc62 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:06.354275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-842e4fcd-773d-48b4-a227-f590df65fc62 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc84d32966d34ff29620cd40d3d9cc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ef95aec46649a2b057416827ea46aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:06.361817 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-842e4fcd-773d-48b4-a227-f590df65fc62 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 200 len: 1523 microversion: 2.1 time: 0.152770 Mar 30 07:21:06.362479 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 327/636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:06 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:06.636203 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-001162cb-f0b8-4a2d-bd2e-5536505c74ac req-d14072d3-be4e-474a-a2e7-0b27446c21af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fedaffa-1632-4376-a01c-64b81265770e", "name": "network-vif-deleted", "tag": "8b69b063-2bbd-4852-b768-a54773d55703"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:06.645598 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-001162cb-f0b8-4a2d-bd2e-5536505c74ac req-d14072d3-be4e-474a-a2e7-0b27446c21af service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:06.646059 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-001162cb-f0b8-4a2d-bd2e-5536505c74ac req-d14072d3-be4e-474a-a2e7-0b27446c21af service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:06.658860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-001162cb-f0b8-4a2d-bd2e-5536505c74ac req-d14072d3-be4e-474a-a2e7-0b27446c21af service nova] Creating event network-vif-deleted:8b69b063-2bbd-4852-b768-a54773d55703 for instance 7fedaffa-1632-4376-a01c-64b81265770e on hv-cinder-83577 Mar 30 07:21:06.664487 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-001162cb-f0b8-4a2d-bd2e-5536505c74ac req-d14072d3-be4e-474a-a2e7-0b27446c21af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032257 Mar 30 07:21:06.665283 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 310/637] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:06.985962 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:06.986665 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:06.993423 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:06.994685 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:06.995720 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:06.996298 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:07.140841 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:07.150727 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:07.152247 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:07.153457 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4457cc62-9f11-4f63-a976-432438ba9b7e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1746 microversion: 2.20 time: 0.171540 Mar 30 07:21:07.154023 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 328/638] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:06 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:07.379795 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:07.380747 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] [instance: 7fedaffa-1632-4376-a01c-64b81265770e] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:07.388211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:07.388678 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:07.389451 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:07.389876 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:07.406337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] HTTP exception thrown: Instance 7fedaffa-1632-4376-a01c-64b81265770e could not be found. Mar 30 07:21:07.406971 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] Returning 404 to user: Instance 7fedaffa-1632-4376-a01c-64b81265770e could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:21:07.407851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2f7caf79-63da-474e-bb71-f1e772b355f9 tempest-ServerRescueNegativeTestJSON-1826638167 tempest-ServerRescueNegativeTestJSON-1826638167-project] 10.222.0.20 "GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e" status: 404 len: 111 microversion: 2.1 time: 0.033144 Mar 30 07:21:07.408396 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 311/639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:07 2022] GET /compute/v2.1/servers/7fedaffa-1632-4376-a01c-64b81265770e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:08.171686 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:08.172356 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:08.181539 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:08.182315 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:08.183167 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:08.183973 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:08.498821 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:08.507893 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:08.510790 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:08.513719 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-eb31b604-4415-4f64-9129-2bd8d47a748b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1741 microversion: 2.20 time: 0.346022 Mar 30 07:21:08.525385 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 329/640] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:08 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1741 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:08.835061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-33199769-58f8-4739-a9b0-3aa943c97d86 req-cfb94699-5433-44e3-86ec-38c97c424af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e370a461-4e4d-4b34-87f6-fe6e3ba548b6", "name": "network-vif-plugged", "status": "completed", "tag": "e4a2a22a-64df-4018-a002-940abcd5bbba"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:08.846420 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-33199769-58f8-4739-a9b0-3aa943c97d86 req-cfb94699-5433-44e3-86ec-38c97c424af2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:08.846901 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-33199769-58f8-4739-a9b0-3aa943c97d86 req-cfb94699-5433-44e3-86ec-38c97c424af2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:08.858895 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-33199769-58f8-4739-a9b0-3aa943c97d86 req-cfb94699-5433-44e3-86ec-38c97c424af2 service nova] Creating event network-vif-plugged:e4a2a22a-64df-4018-a002-940abcd5bbba for instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 on hv-cinder-83577 Mar 30 07:21:08.864547 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-33199769-58f8-4739-a9b0-3aa943c97d86 req-cfb94699-5433-44e3-86ec-38c97c424af2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180911 Mar 30 07:21:08.865856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 312/641] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:09.531982 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:09.533309 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:09.540632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:09.541351 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:09.542484 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:09.543134 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:09.805101 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:09.817197 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:09.818807 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:09.820141 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-964466bf-83a8-4d64-a9ac-7d0769b8fe73 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1741 microversion: 2.20 time: 0.292345 Mar 30 07:21:09.821102 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 330/642] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:09 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:10.843571 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:10.844301 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:10.861740 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:10.862283 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:10.863254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:10.863692 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:11.145125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:11.169890 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:11.171290 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:11.172503 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-116c8e30-099c-43d9-9ee1-dcbaed387945 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1741 microversion: 2.20 time: 0.334396 Mar 30 07:21:11.179284 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 313/643] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:10 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1741 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:12.198961 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:12.199659 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:12.208393 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:12.210194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:12.211368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:12.212102 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:12.408659 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:12.420693 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:12.425866 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:12.427302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-52f05e1d-e003-4e57-888e-a522796f6f0c tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1741 microversion: 2.20 time: 0.234276 Mar 30 07:21:12.430603 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 331/644] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:12 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:13.468098 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:13.468098 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:13.488518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:13.488518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:13.488518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:13.488518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:13.589066 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6dafa695-0228-4636-8fc8-d16bcc3f672c tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] Action: 'create', calling method: .version_select at 0x7f153fe06700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1130263275", "metadata": {"Type": "work"}}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:13.642157 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:13.651725 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:13.653446 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:13.654615 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-892d4442-0135-4903-a0f5-9143aeb8f79d tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1741 microversion: 2.20 time: 0.211613 Mar 30 07:21:13.665614 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 332/645] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:13 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:13.921273 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6dafa695-0228-4636-8fc8-d16bcc3f672c tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.532431 Mar 30 07:21:13.921899 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 314/646] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Mar 30 07:21:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 534 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 30 07:21:13.933625 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-caf7a5d7-8809-48c6-a87c-9e9376749c6d tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] Calling method '.version_select at 0x7f154c5b29d0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:13.988185 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-caf7a5d7-8809-48c6-a87c-9e9376749c6d tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de" status: 200 len: 353 microversion: 2.1 time: 0.059043 Mar 30 07:21:13.988968 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 333/647] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:21:13 2022] GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:21:14.673823 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:14.675415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:14.681936 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:14.682630 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:14.683536 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:14.684075 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:14.830086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:14.838715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:14.840336 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:14.841743 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fc2f97ae-7b54-4d34-ae5a-865d9c9dbad2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1741 microversion: 2.20 time: 0.172516 Mar 30 07:21:14.842830 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 315/648] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:14 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:15.001884 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f246bb35-2720-497b-ba41-8cca46fe0461 tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] Calling method '.version_select at 0x7f154c54f4c0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:15.057321 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f246bb35-2720-497b-ba41-8cca46fe0461 tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de" status: 200 len: 354 microversion: 2.1 time: 0.059831 Mar 30 07:21:15.058396 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 334/649] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:21:14 2022] GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:15.069879 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8b8ccadf-d8d8-441d-b1b0-dedc72df8a50 tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] Calling method '.version_select at 0x7f153fe1df70>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:15.120805 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-8b8ccadf-d8d8-441d-b1b0-dedc72df8a50 tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de" status: 200 len: 354 microversion: 2.1 time: 0.055412 Mar 30 07:21:15.121788 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 316/650] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:21:15 2022] GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:15.138447 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-21577bd7-3ccb-4aef-b3c4-bcfbfb5c9e0c tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] Calling method '.version_select at 0x7f154c5baca0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:15.204521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-21577bd7-3ccb-4aef-b3c4-bcfbfb5c9e0c tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de" status: 202 len: 0 microversion: 2.1 time: 0.069761 Mar 30 07:21:15.215886 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a7d439fe-1858-49cb-bd44-15ed9e89f57e tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] Calling method '.version_select at 0x7f154c0cff70>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:15.217284 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 335/651] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:21:15 2022] DELETE /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:21:15.268394 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a7d439fe-1858-49cb-bd44-15ed9e89f57e tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de" status: 200 len: 353 microversion: 2.1 time: 0.057839 Mar 30 07:21:15.269149 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 317/652] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:21:15 2022] GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:15.860320 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:15.860926 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:15.869659 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:15.870149 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:15.870910 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:15.871376 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:16.033406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:16.041938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:16.043633 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:16.045067 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c0d3f160-4b4a-40c5-86e8-d14558d08450 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1741 microversion: 2.20 time: 0.188637 Mar 30 07:21:16.046211 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 336/653] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:15 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:16.284925 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bf510e58-bced-4416-acfd-dcd72c801cf2 tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] Calling method '.version_select at 0x7f153fdf0670>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:16.318402 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-bf510e58-bced-4416-acfd-dcd72c801cf2 tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] HTTP exception thrown: Volume 3f655e4e-211b-4eba-85bc-64ef96f532de could not be found. Mar 30 07:21:16.319109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bf510e58-bced-4416-acfd-dcd72c801cf2 tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] Returning 404 to user: Volume 3f655e4e-211b-4eba-85bc-64ef96f532de could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:21:16.319995 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-bf510e58-bced-4416-acfd-dcd72c801cf2 tempest-VolumesGetTestJSON-743080704 tempest-VolumesGetTestJSON-743080704-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de" status: 404 len: 109 microversion: 2.1 time: 0.042071 Mar 30 07:21:16.320532 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 318/654] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:21:16 2022] GET /compute/v2.1/os-volumes/3f655e4e-211b-4eba-85bc-64ef96f532de => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:17.063987 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:17.064575 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:17.070674 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:17.071114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:17.072094 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:17.072765 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:17.218274 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:17.226570 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:17.228451 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:17.229611 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-31b8a5f3-90e6-467b-a6f8-b7386d9f38c8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1741 microversion: 2.20 time: 0.169611 Mar 30 07:21:17.230146 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 337/655] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:17 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:21:18.248622 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:18.249234 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:18.256370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:18.256818 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:18.257591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:18.258011 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:18.394393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:18.402148 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:18.403582 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:18.404753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a4a06ad5-7545-483c-98ce-cb869a9231fc tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1723 microversion: 2.20 time: 0.160348 Mar 30 07:21:18.405315 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 319/656] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:18 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:19.426019 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:19.426669 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:19.433880 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:19.434316 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:19.435128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:19.435564 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:19.596206 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:19.606858 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:19.609075 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:19.611965 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1bc4b22a-63a6-40e7-9bfd-42cafd7555d3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1723 microversion: 2.20 time: 0.190104 Mar 30 07:21:19.615896 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 338/657] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:19 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:20.551214 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a5d75593-8f16-486a-bf59-c954c40b0b26 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:20.551780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a5d75593-8f16-486a-bf59-c954c40b0b26 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:20.559257 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5d75593-8f16-486a-bf59-c954c40b0b26 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:20.559837 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5d75593-8f16-486a-bf59-c954c40b0b26 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:20.560677 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5d75593-8f16-486a-bf59-c954c40b0b26 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:20.561178 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5d75593-8f16-486a-bf59-c954c40b0b26 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:20.587182 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a5d75593-8f16-486a-bf59-c954c40b0b26 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/ips" status: 200 len: 146 microversion: 2.1 time: 0.039836 Mar 30 07:21:20.588441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 320/658] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:21:20 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:20.630745 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:20.631395 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:20.637963 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:20.638707 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:20.639905 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:20.640500 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:20.837966 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-18a4ec63-e155-465b-b302-a3a8e04c55d9 req-1a9cafe0-8293-494d-b566-849fa2602432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e370a461-4e4d-4b34-87f6-fe6e3ba548b6", "name": "network-vif-unplugged", "status": "completed", "tag": "e4a2a22a-64df-4018-a002-940abcd5bbba"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:20.854202 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-18a4ec63-e155-465b-b302-a3a8e04c55d9 req-1a9cafe0-8293-494d-b566-849fa2602432 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:20.854747 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-18a4ec63-e155-465b-b302-a3a8e04c55d9 req-1a9cafe0-8293-494d-b566-849fa2602432 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:20.855738 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:20.867452 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:20.871585 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:20.873059 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-349d64dc-9c1e-42e9-af27-e68ab19e78c9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1666 microversion: 2.20 time: 0.246622 Mar 30 07:21:20.875985 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 339/659] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:20 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1666 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:20.883254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.compute.server_external_events [req-18a4ec63-e155-465b-b302-a3a8e04c55d9 req-1a9cafe0-8293-494d-b566-849fa2602432 service nova] Unable to find a host for instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6. Dropping event network-vif-unplugged {{(pid=117063) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 30 07:21:20.884465 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-18a4ec63-e155-465b-b302-a3a8e04c55d9 req-1a9cafe0-8293-494d-b566-849fa2602432 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055834 Mar 30 07:21:20.885175 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 321/660] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 30 07:21:20.904252 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-8f1c549e-ba8a-4a84-8bc1-9eeaa497b6b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d76455c0-f0e8-47bc-b325-c1c137a5fcfb"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:20.907041 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-8f1c549e-ba8a-4a84-8bc1-9eeaa497b6b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:20.924852 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8f1c549e-ba8a-4a84-8bc1-9eeaa497b6b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:20.925452 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8f1c549e-ba8a-4a84-8bc1-9eeaa497b6b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:20.927995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8f1c549e-ba8a-4a84-8bc1-9eeaa497b6b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:20.927995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8f1c549e-ba8a-4a84-8bc1-9eeaa497b6b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:21.233579 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-8f1c549e-ba8a-4a84-8bc1-9eeaa497b6b9 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335532 Mar 30 07:21:21.239317 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 340/661] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Mar 30 07:21:20 2022] POST /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/os-volume_attachments => generated 188 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 30 07:21:21.353387 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-87ec8cd2-8f3a-4435-bfdd-2f46a6433206 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:21.353882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-87ec8cd2-8f3a-4435-bfdd-2f46a6433206 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:21.360220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87ec8cd2-8f3a-4435-bfdd-2f46a6433206 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:21.360677 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87ec8cd2-8f3a-4435-bfdd-2f46a6433206 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:21.361418 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87ec8cd2-8f3a-4435-bfdd-2f46a6433206 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:21.361902 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87ec8cd2-8f3a-4435-bfdd-2f46a6433206 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:21.612341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-87ec8cd2-8f3a-4435-bfdd-2f46a6433206 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/os-volume_attachments/d76455c0-f0e8-47bc-b325-c1c137a5fcfb" status: 202 len: 0 microversion: 2.20 time: 0.263389 Mar 30 07:21:21.613245 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 322/662] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Mar 30 07:21:21 2022] DELETE /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/os-volume_attachments/d76455c0-f0e8-47bc-b325-c1c137a5fcfb => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:21:21.673542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-02663340-0fa2-4bc9-84d2-00e46a5a128b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:21.674098 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-02663340-0fa2-4bc9-84d2-00e46a5a128b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:21.849000 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-02663340-0fa2-4bc9-84d2-00e46a5a128b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:21.849455 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-02663340-0fa2-4bc9-84d2-00e46a5a128b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:21.850246 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-02663340-0fa2-4bc9-84d2-00e46a5a128b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:21.850682 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-02663340-0fa2-4bc9-84d2-00e46a5a128b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:21.935079 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-02663340-0fa2-4bc9-84d2-00e46a5a128b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "POST /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/action" status: 202 len: 0 microversion: 2.20 time: 0.265546 Mar 30 07:21:21.935889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 341/663] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Mar 30 07:21:21 2022] POST /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:21:21.944078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:21.944683 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:21.952870 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:21.953542 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:21.954330 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:21.954773 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:22.041595 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1f312bc5-aa87-4fc3-81dd-44049efdc1d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "679f44e7-1823-4031-a0fc-a7eba6dcaed8"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:22.043848 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1f312bc5-aa87-4fc3-81dd-44049efdc1d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:22.052128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1f312bc5-aa87-4fc3-81dd-44049efdc1d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:22.052905 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1f312bc5-aa87-4fc3-81dd-44049efdc1d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:22.053956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1f312bc5-aa87-4fc3-81dd-44049efdc1d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:22.054542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1f312bc5-aa87-4fc3-81dd-44049efdc1d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:22.369903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:22.379194 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:22.380840 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:22.382719 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0eda781a-0bb0-4604-ac0a-a362a5cb91cd tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1674 microversion: 2.20 time: 0.442834 Mar 30 07:21:22.384029 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 323/664] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:21 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1674 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:22.416069 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1f312bc5-aa87-4fc3-81dd-44049efdc1d3 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377751 Mar 30 07:21:22.417314 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 342/665] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:21:22 2022] POST /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:21:23.402264 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:23.402880 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:23.409961 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:23.410408 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:23.411596 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:23.412165 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:23.551317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:23.559287 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:23.560815 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:23.561999 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6c0569be-79a4-473c-a5c7-4097c8820056 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1676 microversion: 2.20 time: 0.163874 Mar 30 07:21:23.562563 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 324/666] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:23 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:21:24.581637 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:24.582827 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:24.590582 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:24.591029 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:24.591800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:24.592280 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:24.744083 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:24.752026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:24.753523 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:24.755122 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a113f5ad-9cfe-4a2e-a989-1bf7f9a7e6ef tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.177934 Mar 30 07:21:24.755839 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 343/667] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:24 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:25.776849 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:25.777450 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:25.786347 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:25.786888 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:25.788078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:25.788454 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:25.939201 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:25.947654 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:25.949196 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:25.950377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a9b67ff0-e5f3-473f-84cf-916911d81d74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.179638 Mar 30 07:21:25.951121 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 325/668] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:25 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:26.970499 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:26.972122 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:26.982302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:26.983011 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:26.984068 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:26.985380 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:27.192215 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:27.201487 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:27.202988 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:27.204582 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3d86744e-4d55-4b4c-aab3-7e2f0bb353a4 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.238151 Mar 30 07:21:27.205305 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 344/669] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:26 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:21:28.222765 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:28.223458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:28.231030 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:28.231486 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:28.232389 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:28.232916 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:28.375369 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:28.383798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:28.385320 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:28.386676 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5f3a29a3-b1f6-47ad-b684-11e255b3dbf2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.167955 Mar 30 07:21:28.394311 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 326/670] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:28 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:29.410457 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:29.412991 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:29.420810 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:29.421500 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:29.422517 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:29.423146 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:29.675925 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:29.686249 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:29.688158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:29.694456 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d45edf0b-3f25-498a-89f7-537a693dff8a tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.290799 Mar 30 07:21:29.694818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 345/671] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:29 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:30.712680 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:30.713397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:30.722839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:30.723384 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:30.724430 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:30.724860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:30.900634 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:30.909094 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:30.911082 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:30.912616 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a9ac03dc-4b25-4f27-a8e1-f027146edad5 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.204028 Mar 30 07:21:30.913717 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 327/672] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:30 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:31.932615 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:31.934490 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:31.942971 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:31.943407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:31.944222 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:31.944810 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:32.144873 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:32.155034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:32.156653 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:32.157882 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7d4a15db-2772-47ef-825c-55ab7f1b1ab3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.229227 Mar 30 07:21:32.158785 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 346/673] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:31 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 30 07:21:33.176512 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:33.177137 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:33.183738 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:33.184102 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:33.184839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:33.185271 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:33.329495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:33.338103 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:33.339802 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:33.341112 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d705e821-c96d-4925-b858-a341994a29f8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.168653 Mar 30 07:21:33.342060 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 328/674] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:33 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:34.283427 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-de1ce6ce-fbe2-4b83-8f40-76e0e34c1606 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:34.284429 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-de1ce6ce-fbe2-4b83-8f40-76e0e34c1606 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:34.291525 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-de1ce6ce-fbe2-4b83-8f40-76e0e34c1606 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:34.292074 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-de1ce6ce-fbe2-4b83-8f40-76e0e34c1606 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:34.293034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-de1ce6ce-fbe2-4b83-8f40-76e0e34c1606 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:34.293463 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-de1ce6ce-fbe2-4b83-8f40-76e0e34c1606 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:34.325304 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-de1ce6ce-fbe2-4b83-8f40-76e0e34c1606 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Mar 30 07:21:34.332294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 347/675] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:21:34 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:34.342198 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-dcd0e830-c134-4a64-b6d9-14f7d0f7ff0c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:34.342725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-dcd0e830-c134-4a64-b6d9-14f7d0f7ff0c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:34.349439 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcd0e830-c134-4a64-b6d9-14f7d0f7ff0c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:34.349891 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcd0e830-c134-4a64-b6d9-14f7d0f7ff0c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:34.350718 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcd0e830-c134-4a64-b6d9-14f7d0f7ff0c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:34.351163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcd0e830-c134-4a64-b6d9-14f7d0f7ff0c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:34.361565 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:34.362711 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:34.373290 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:34.373735 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:34.374691 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:34.375134 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:34.384021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-dcd0e830-c134-4a64-b6d9-14f7d0f7ff0c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/679f44e7-1823-4031-a0fc-a7eba6dcaed8" status: 200 len: 194 microversion: 2.1 time: 0.045713 Mar 30 07:21:34.385179 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 329/676] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Mar 30 07:21:34 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/679f44e7-1823-4031-a0fc-a7eba6dcaed8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:34.520324 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:34.529345 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:34.530844 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:34.532060 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e02e42b5-cd8b-4d2e-a2dc-44405fa38c5b tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.175678 Mar 30 07:21:34.532624 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 348/677] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:34 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:35.550766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:35.551507 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:35.558866 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:35.559319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:35.560260 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:35.560690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:35.716117 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:35.716117 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:35.716583 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:35.716583 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-22963c25-6943-48e6-84c4-4760cf3269e6 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.169305 Mar 30 07:21:35.716986 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 330/678] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:35 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:35.718702 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-51d02212-ff21-4289-afdd-0873c11e23a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c40ad61-f0c5-401f-848c-17e42e1b1a41"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:35.719770 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-51d02212-ff21-4289-afdd-0873c11e23a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:35.726826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-51d02212-ff21-4289-afdd-0873c11e23a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:35.727267 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-51d02212-ff21-4289-afdd-0873c11e23a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:35.728453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-51d02212-ff21-4289-afdd-0873c11e23a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:35.728856 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-51d02212-ff21-4289-afdd-0873c11e23a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:35.996953 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-51d02212-ff21-4289-afdd-0873c11e23a9 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "POST /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282099 Mar 30 07:21:35.997592 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 349/679] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:21:35 2022] POST /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:21:36.736274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:36.737016 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:36.743375 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:36.743841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:36.744619 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:36.745089 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:36.811644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-5f2f0e44-a39a-4e85-82c8-fbc21652dfa1 req-9065197e-6e5a-4570-83da-831009186fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e370a461-4e4d-4b34-87f6-fe6e3ba548b6", "name": "network-vif-plugged", "status": "completed", "tag": "e4a2a22a-64df-4018-a002-940abcd5bbba"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:36.834261 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-5f2f0e44-a39a-4e85-82c8-fbc21652dfa1 req-9065197e-6e5a-4570-83da-831009186fac service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:36.834705 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-5f2f0e44-a39a-4e85-82c8-fbc21652dfa1 req-9065197e-6e5a-4570-83da-831009186fac service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:36.849332 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-5f2f0e44-a39a-4e85-82c8-fbc21652dfa1 req-9065197e-6e5a-4570-83da-831009186fac service nova] Creating event network-vif-plugged:e4a2a22a-64df-4018-a002-940abcd5bbba for instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 on hv-cinder-83577 Mar 30 07:21:36.856217 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-5f2f0e44-a39a-4e85-82c8-fbc21652dfa1 req-9065197e-6e5a-4570-83da-831009186fac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050367 Mar 30 07:21:36.857035 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 350/680] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:36.913000 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:36.921996 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:36.923512 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:36.924713 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-39c6a88c-cc99-47fe-b5cd-ee1bcf12f745 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.193267 Mar 30 07:21:36.925285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 331/681] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:36 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:37.944945 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:37.945537 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:37.953014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:37.953458 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:37.954267 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:37.954738 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:38.099306 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d7b17807-b8c0-42a9-845f-3c9abcd199fd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:38.100508 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d7b17807-b8c0-42a9-845f-3c9abcd199fd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:38.109961 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d7b17807-b8c0-42a9-845f-3c9abcd199fd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:38.110262 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d7b17807-b8c0-42a9-845f-3c9abcd199fd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:38.111284 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d7b17807-b8c0-42a9-845f-3c9abcd199fd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:38.111716 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d7b17807-b8c0-42a9-845f-3c9abcd199fd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:38.140291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-d7b17807-b8c0-42a9-845f-3c9abcd199fd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lazy-loading 'flavor' on Instance uuid 1770fd40-dd13-44c5-a045-2552bc5420dd {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:21:38.175635 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:38.185184 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:38.187494 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:38.189081 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7e2ff9e7-7941-48b4-8897-2534eab86075 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1732 microversion: 2.20 time: 0.248943 Mar 30 07:21:38.189638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 351/682] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:37 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1732 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:38.226933 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d7b17807-b8c0-42a9-845f-3c9abcd199fd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "POST /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd/action" status: 202 len: 0 microversion: 2.1 time: 0.133447 Mar 30 07:21:38.227667 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 332/683] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:21:38 2022] POST /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:21:38.236858 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6987ad03-f4d5-47a9-b59b-5d520652d793 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:38.237804 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6987ad03-f4d5-47a9-b59b-5d520652d793 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:38.245792 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6987ad03-f4d5-47a9-b59b-5d520652d793 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:38.246470 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6987ad03-f4d5-47a9-b59b-5d520652d793 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:38.247463 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6987ad03-f4d5-47a9-b59b-5d520652d793 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:38.248132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6987ad03-f4d5-47a9-b59b-5d520652d793 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:38.414302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6987ad03-f4d5-47a9-b59b-5d520652d793 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:38.422115 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6987ad03-f4d5-47a9-b59b-5d520652d793 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.189544 Mar 30 07:21:38.422920 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 352/684] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:38 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:39.210069 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:39.210627 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:39.223190 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:39.223672 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:39.224634 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:39.225241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:39.360835 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:39.368869 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:39.370349 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:39.371489 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-25553669-670b-486e-b96a-7fb5a3434717 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1719 microversion: 2.20 time: 0.167170 Mar 30 07:21:39.372074 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 333/685] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:21:39 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:21:39.441231 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-dea88d63-9beb-457d-b2a1-e4349d20795e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:39.441840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-dea88d63-9beb-457d-b2a1-e4349d20795e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:39.449041 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dea88d63-9beb-457d-b2a1-e4349d20795e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:39.449453 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dea88d63-9beb-457d-b2a1-e4349d20795e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:39.450225 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dea88d63-9beb-457d-b2a1-e4349d20795e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:39.450651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dea88d63-9beb-457d-b2a1-e4349d20795e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:39.592502 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-dea88d63-9beb-457d-b2a1-e4349d20795e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:39.600093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-dea88d63-9beb-457d-b2a1-e4349d20795e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.162955 Mar 30 07:21:39.600689 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 353/686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:39 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:21:40.618332 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-95087f78-e763-4072-9cec-ff336c1d9ae8 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:40.619118 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-95087f78-e763-4072-9cec-ff336c1d9ae8 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:40.628527 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-95087f78-e763-4072-9cec-ff336c1d9ae8 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:40.629008 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-95087f78-e763-4072-9cec-ff336c1d9ae8 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:40.630123 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-95087f78-e763-4072-9cec-ff336c1d9ae8 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:40.630746 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-95087f78-e763-4072-9cec-ff336c1d9ae8 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:40.777926 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-95087f78-e763-4072-9cec-ff336c1d9ae8 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:40.785654 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-95087f78-e763-4072-9cec-ff336c1d9ae8 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.171545 Mar 30 07:21:40.786263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 334/687] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:40 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:41.803770 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5abb765d-a0c3-43ec-8d59-04907775c86f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:41.804835 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5abb765d-a0c3-43ec-8d59-04907775c86f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:41.811255 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5abb765d-a0c3-43ec-8d59-04907775c86f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:41.811721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5abb765d-a0c3-43ec-8d59-04907775c86f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:41.812541 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5abb765d-a0c3-43ec-8d59-04907775c86f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:41.812980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5abb765d-a0c3-43ec-8d59-04907775c86f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:42.020636 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5abb765d-a0c3-43ec-8d59-04907775c86f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:42.031867 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5abb765d-a0c3-43ec-8d59-04907775c86f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.232864 Mar 30 07:21:42.032654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 354/688] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:41 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:43.048898 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c9ed8df9-da82-40ac-93ac-32a3a87ffdba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:43.049606 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c9ed8df9-da82-40ac-93ac-32a3a87ffdba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:43.056589 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c9ed8df9-da82-40ac-93ac-32a3a87ffdba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:43.057272 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c9ed8df9-da82-40ac-93ac-32a3a87ffdba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:43.058081 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c9ed8df9-da82-40ac-93ac-32a3a87ffdba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:43.058500 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c9ed8df9-da82-40ac-93ac-32a3a87ffdba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:43.220128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c9ed8df9-da82-40ac-93ac-32a3a87ffdba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:43.228874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c9ed8df9-da82-40ac-93ac-32a3a87ffdba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.184207 Mar 30 07:21:43.229539 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 335/689] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:43 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:43.520369 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-dcfd9bf6-aa49-47f7-b100-0bec18ea7f0f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:43.521437 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-dcfd9bf6-aa49-47f7-b100-0bec18ea7f0f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:43.527820 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dcfd9bf6-aa49-47f7-b100-0bec18ea7f0f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:43.528288 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dcfd9bf6-aa49-47f7-b100-0bec18ea7f0f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:43.529207 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dcfd9bf6-aa49-47f7-b100-0bec18ea7f0f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:43.529644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dcfd9bf6-aa49-47f7-b100-0bec18ea7f0f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:43.558969 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-dcfd9bf6-aa49-47f7-b100-0bec18ea7f0f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042629 Mar 30 07:21:43.571828 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 355/690] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:21:43 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:43.710743 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3f0b99c1-a04e-4f61-a498-4770890ade43 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:43.711235 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3f0b99c1-a04e-4f61-a498-4770890ade43 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:43.719181 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3f0b99c1-a04e-4f61-a498-4770890ade43 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:43.719699 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3f0b99c1-a04e-4f61-a498-4770890ade43 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:43.720501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3f0b99c1-a04e-4f61-a498-4770890ade43 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:43.720937 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3f0b99c1-a04e-4f61-a498-4770890ade43 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:43.761077 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3f0b99c1-a04e-4f61-a498-4770890ade43 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/679f44e7-1823-4031-a0fc-a7eba6dcaed8" status: 200 len: 194 microversion: 2.1 time: 0.059638 Mar 30 07:21:43.761772 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 336/691] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Mar 30 07:21:43 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/679f44e7-1823-4031-a0fc-a7eba6dcaed8 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:43.771681 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6e7e9dd2-7e7b-4eb5-8988-ee1dfb919729 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:43.772198 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6e7e9dd2-7e7b-4eb5-8988-ee1dfb919729 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:43.778343 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6e7e9dd2-7e7b-4eb5-8988-ee1dfb919729 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:43.778791 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6e7e9dd2-7e7b-4eb5-8988-ee1dfb919729 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:43.779586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6e7e9dd2-7e7b-4eb5-8988-ee1dfb919729 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:43.780052 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6e7e9dd2-7e7b-4eb5-8988-ee1dfb919729 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:43.864594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-6e7e9dd2-7e7b-4eb5-8988-ee1dfb919729 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lazy-loading 'services' on Instance uuid 14430ed1-6f8f-4808-81fa-ac17c639f964 {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:21:43.934923 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6e7e9dd2-7e7b-4eb5-8988-ee1dfb919729 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/679f44e7-1823-4031-a0fc-a7eba6dcaed8" status: 202 len: 0 microversion: 2.1 time: 0.167022 Mar 30 07:21:43.935545 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 356/692] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:21:43 2022] DELETE /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/679f44e7-1823-4031-a0fc-a7eba6dcaed8 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 30 07:21:44.247029 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6c1a9b55-47a0-4289-a3aa-70e8ce702d6b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:44.247578 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6c1a9b55-47a0-4289-a3aa-70e8ce702d6b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:44.254021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c1a9b55-47a0-4289-a3aa-70e8ce702d6b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:44.254450 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c1a9b55-47a0-4289-a3aa-70e8ce702d6b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:44.255288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c1a9b55-47a0-4289-a3aa-70e8ce702d6b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:44.255917 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c1a9b55-47a0-4289-a3aa-70e8ce702d6b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:44.515998 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6c1a9b55-47a0-4289-a3aa-70e8ce702d6b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:44.530075 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6c1a9b55-47a0-4289-a3aa-70e8ce702d6b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.287232 Mar 30 07:21:44.530669 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 337/693] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:44 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:45.177097 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2a9db309-cdbe-440d-8ea5-dba446e7ad55 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:45.177892 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2a9db309-cdbe-440d-8ea5-dba446e7ad55 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:45.184375 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2a9db309-cdbe-440d-8ea5-dba446e7ad55 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:45.184845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2a9db309-cdbe-440d-8ea5-dba446e7ad55 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:45.185613 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2a9db309-cdbe-440d-8ea5-dba446e7ad55 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:45.186047 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2a9db309-cdbe-440d-8ea5-dba446e7ad55 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:45.221119 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2a9db309-cdbe-440d-8ea5-dba446e7ad55 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/8c40ad61-f0c5-401f-848c-17e42e1b1a41" status: 200 len: 194 microversion: 2.1 time: 0.048819 Mar 30 07:21:45.221737 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 357/694] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Mar 30 07:21:45 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/8c40ad61-f0c5-401f-848c-17e42e1b1a41 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:45.232738 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3706dfc1-8cb7-41b3-808b-9364d573c94d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:45.233323 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3706dfc1-8cb7-41b3-808b-9364d573c94d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:45.239270 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3706dfc1-8cb7-41b3-808b-9364d573c94d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:45.240283 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3706dfc1-8cb7-41b3-808b-9364d573c94d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:45.241060 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3706dfc1-8cb7-41b3-808b-9364d573c94d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:45.241522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3706dfc1-8cb7-41b3-808b-9364d573c94d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:45.489484 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-3706dfc1-8cb7-41b3-808b-9364d573c94d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lazy-loading 'services' on Instance uuid 14430ed1-6f8f-4808-81fa-ac17c639f964 {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:21:45.546882 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bb819ce3-9471-4013-bab4-e416ad5850bd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:45.547503 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bb819ce3-9471-4013-bab4-e416ad5850bd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:45.553516 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bb819ce3-9471-4013-bab4-e416ad5850bd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:45.553969 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bb819ce3-9471-4013-bab4-e416ad5850bd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:45.554745 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bb819ce3-9471-4013-bab4-e416ad5850bd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:45.555163 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bb819ce3-9471-4013-bab4-e416ad5850bd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:45.562295 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3706dfc1-8cb7-41b3-808b-9364d573c94d tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/8c40ad61-f0c5-401f-848c-17e42e1b1a41" status: 202 len: 0 microversion: 2.1 time: 0.334215 Mar 30 07:21:45.563092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 338/695] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:21:45 2022] DELETE /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments/8c40ad61-f0c5-401f-848c-17e42e1b1a41 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:21:45.700713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bb819ce3-9471-4013-bab4-e416ad5850bd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:45.709353 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bb819ce3-9471-4013-bab4-e416ad5850bd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.166212 Mar 30 07:21:45.710007 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 358/696] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:45 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:46.728479 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-31d49cee-664c-42ea-91f7-a92e3636955f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:46.729180 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-31d49cee-664c-42ea-91f7-a92e3636955f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:46.735650 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31d49cee-664c-42ea-91f7-a92e3636955f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:46.736128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31d49cee-664c-42ea-91f7-a92e3636955f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:46.736887 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31d49cee-664c-42ea-91f7-a92e3636955f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:46.737311 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31d49cee-664c-42ea-91f7-a92e3636955f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:46.738367 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f982c52e-6928-44ff-ac39-1d0d7b5b158c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:46.739298 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f982c52e-6928-44ff-ac39-1d0d7b5b158c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:46.745664 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f982c52e-6928-44ff-ac39-1d0d7b5b158c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:46.746110 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f982c52e-6928-44ff-ac39-1d0d7b5b158c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:46.746880 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f982c52e-6928-44ff-ac39-1d0d7b5b158c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:46.747306 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f982c52e-6928-44ff-ac39-1d0d7b5b158c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:46.776117 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f982c52e-6928-44ff-ac39-1d0d7b5b158c tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042999 Mar 30 07:21:46.776680 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 359/697] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:21:46 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:21:46.881887 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-64b8a520-ceb9-47c7-b23d-c82f6f5e3c9f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:46.882920 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-64b8a520-ceb9-47c7-b23d-c82f6f5e3c9f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:46.885099 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-31d49cee-664c-42ea-91f7-a92e3636955f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:46.889185 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-64b8a520-ceb9-47c7-b23d-c82f6f5e3c9f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:46.889672 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-64b8a520-ceb9-47c7-b23d-c82f6f5e3c9f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:46.890454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-64b8a520-ceb9-47c7-b23d-c82f6f5e3c9f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:46.890889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-64b8a520-ceb9-47c7-b23d-c82f6f5e3c9f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:46.892815 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-31d49cee-664c-42ea-91f7-a92e3636955f tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.169938 Mar 30 07:21:46.893387 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 339/698] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:46 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:46.921079 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-64b8a520-ceb9-47c7-b23d-c82f6f5e3c9f tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043930 Mar 30 07:21:46.921644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 360/699] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:21:46 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:21:46.979838 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-52736090-5183-446b-991a-2c9366e951a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:46.980340 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-52736090-5183-446b-991a-2c9366e951a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:46.986345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-52736090-5183-446b-991a-2c9366e951a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:46.986788 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-52736090-5183-446b-991a-2c9366e951a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:46.987538 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-52736090-5183-446b-991a-2c9366e951a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:46.988001 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-52736090-5183-446b-991a-2c9366e951a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:47.012322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-52736090-5183-446b-991a-2c9366e951a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:21:47.098909 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-52736090-5183-446b-991a-2c9366e951a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 204 len: 0 microversion: 2.1 time: 0.122999 Mar 30 07:21:47.099599 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 340/700] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:21:46 2022] DELETE /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 30 07:21:47.109644 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-aac7ad45-54da-4395-91f7-af1ef621ed60 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:47.110646 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-aac7ad45-54da-4395-91f7-af1ef621ed60 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:47.117212 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-aac7ad45-54da-4395-91f7-af1ef621ed60 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:47.117665 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-aac7ad45-54da-4395-91f7-af1ef621ed60 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:47.118439 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-aac7ad45-54da-4395-91f7-af1ef621ed60 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:47.118873 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-aac7ad45-54da-4395-91f7-af1ef621ed60 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:47.264638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-aac7ad45-54da-4395-91f7-af1ef621ed60 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:47.272743 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-aac7ad45-54da-4395-91f7-af1ef621ed60 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1674 microversion: 2.1 time: 0.168130 Mar 30 07:21:47.273280 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 361/701] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:47 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:21:47.910923 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5a195fa3-4e8a-41e8-be84-efad00b3d07d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:47.911706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5a195fa3-4e8a-41e8-be84-efad00b3d07d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:47.918401 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a195fa3-4e8a-41e8-be84-efad00b3d07d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:47.918847 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a195fa3-4e8a-41e8-be84-efad00b3d07d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:47.919620 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a195fa3-4e8a-41e8-be84-efad00b3d07d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:47.920074 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5a195fa3-4e8a-41e8-be84-efad00b3d07d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:48.067646 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5a195fa3-4e8a-41e8-be84-efad00b3d07d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:48.075552 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5a195fa3-4e8a-41e8-be84-efad00b3d07d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.169153 Mar 30 07:21:48.079838 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 341/702] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:47 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:48.297824 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-449e9909-ba61-4c34-8e64-67b41704ead5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:48.298654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-449e9909-ba61-4c34-8e64-67b41704ead5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:48.309955 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-449e9909-ba61-4c34-8e64-67b41704ead5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:48.310757 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-449e9909-ba61-4c34-8e64-67b41704ead5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:48.312081 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-449e9909-ba61-4c34-8e64-67b41704ead5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:48.312793 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-449e9909-ba61-4c34-8e64-67b41704ead5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:48.453364 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-449e9909-ba61-4c34-8e64-67b41704ead5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:48.460953 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-449e9909-ba61-4c34-8e64-67b41704ead5 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1674 microversion: 2.1 time: 0.169762 Mar 30 07:21:48.461512 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 362/703] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:48 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:49.092752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-82eaf5f6-8595-4d3c-a8d1-1bb8bb76baab tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:49.093542 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-82eaf5f6-8595-4d3c-a8d1-1bb8bb76baab tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:49.101752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82eaf5f6-8595-4d3c-a8d1-1bb8bb76baab tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:49.102377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82eaf5f6-8595-4d3c-a8d1-1bb8bb76baab tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:49.103518 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82eaf5f6-8595-4d3c-a8d1-1bb8bb76baab tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:49.104136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82eaf5f6-8595-4d3c-a8d1-1bb8bb76baab tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:49.362945 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-82eaf5f6-8595-4d3c-a8d1-1bb8bb76baab tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:49.371832 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-82eaf5f6-8595-4d3c-a8d1-1bb8bb76baab tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.282904 Mar 30 07:21:49.372413 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 342/704] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:49 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:49.477884 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7cd0fdd3-a71f-4970-bb4b-9e1ae954bfad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:49.478498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7cd0fdd3-a71f-4970-bb4b-9e1ae954bfad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:49.485359 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7cd0fdd3-a71f-4970-bb4b-9e1ae954bfad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:49.485807 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7cd0fdd3-a71f-4970-bb4b-9e1ae954bfad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:49.486586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7cd0fdd3-a71f-4970-bb4b-9e1ae954bfad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:49.487028 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7cd0fdd3-a71f-4970-bb4b-9e1ae954bfad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:49.752574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7cd0fdd3-a71f-4970-bb4b-9e1ae954bfad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:49.760505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7cd0fdd3-a71f-4970-bb4b-9e1ae954bfad tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1674 microversion: 2.1 time: 0.286966 Mar 30 07:21:49.761072 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 363/705] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:49 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1674 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:50.389612 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bb5baba9-e3be-45aa-85a9-0e5430b0cd6e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:50.390332 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-bb5baba9-e3be-45aa-85a9-0e5430b0cd6e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:50.404515 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bb5baba9-e3be-45aa-85a9-0e5430b0cd6e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:50.405124 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bb5baba9-e3be-45aa-85a9-0e5430b0cd6e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:50.408041 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bb5baba9-e3be-45aa-85a9-0e5430b0cd6e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:50.411649 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bb5baba9-e3be-45aa-85a9-0e5430b0cd6e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:50.645991 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-1f2e5a40-8317-4a20-9bcf-5a96d4f8c765 req-93a459e0-4882-4278-9ff0-f0dc041f3df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14430ed1-6f8f-4808-81fa-ac17c639f964", "name": "network-vif-deleted", "tag": "7cd6bbda-aa42-4eaa-819e-1d240a300263"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:50.668093 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-1f2e5a40-8317-4a20-9bcf-5a96d4f8c765 req-93a459e0-4882-4278-9ff0-f0dc041f3df1 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:50.668368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-1f2e5a40-8317-4a20-9bcf-5a96d4f8c765 req-93a459e0-4882-4278-9ff0-f0dc041f3df1 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:50.687963 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-1f2e5a40-8317-4a20-9bcf-5a96d4f8c765 req-93a459e0-4882-4278-9ff0-f0dc041f3df1 service nova] Creating event network-vif-deleted:7cd6bbda-aa42-4eaa-819e-1d240a300263 for instance 14430ed1-6f8f-4808-81fa-ac17c639f964 on hv-cinder-83577 Mar 30 07:21:50.689238 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-bb5baba9-e3be-45aa-85a9-0e5430b0cd6e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:50.693938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-1f2e5a40-8317-4a20-9bcf-5a96d4f8c765 req-93a459e0-4882-4278-9ff0-f0dc041f3df1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203266 Mar 30 07:21:50.694531 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 364/706] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:21:50.698589 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-bb5baba9-e3be-45aa-85a9-0e5430b0cd6e tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.313372 Mar 30 07:21:50.699340 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 343/707] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:50 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:50.780338 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:50.781724 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:50.788640 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:50.789446 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:50.790448 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:50.790846 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:50.832879 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:50.833420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:50.834054 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lazy-loading 'fault' on Instance uuid 14430ed1-6f8f-4808-81fa-ac17c639f964 {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:21:50.875623 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd9d32c47014294a367654b57c96f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9ab7163ff443ff849d017d40115708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:50.883546 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-76672f48-56fd-4997-87fd-d46133bce5a2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 200 len: 1328 microversion: 2.1 time: 0.108181 Mar 30 07:21:50.884126 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 365/708] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:50 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:51.720561 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-079117b0-e2a2-493b-9c23-c68dd4e9767d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:51.721487 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-079117b0-e2a2-493b-9c23-c68dd4e9767d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:51.729934 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-079117b0-e2a2-493b-9c23-c68dd4e9767d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:51.730378 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-079117b0-e2a2-493b-9c23-c68dd4e9767d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:51.731142 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-079117b0-e2a2-493b-9c23-c68dd4e9767d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:51.731570 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-079117b0-e2a2-493b-9c23-c68dd4e9767d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:51.882752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-079117b0-e2a2-493b-9c23-c68dd4e9767d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:51.890705 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-079117b0-e2a2-493b-9c23-c68dd4e9767d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1570 microversion: 2.1 time: 0.176746 Mar 30 07:21:51.891282 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 344/709] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:51 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:51.900594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:51.901786 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:51.907869 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-29ff43ba-702d-4a86-ae04-298f75015e83 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:51.908302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:51.908756 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:51.909723 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:51.910317 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:51.912578 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-29ff43ba-702d-4a86-ae04-298f75015e83 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:51.925170 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-29ff43ba-702d-4a86-ae04-298f75015e83 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:51.925346 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] HTTP exception thrown: Instance 14430ed1-6f8f-4808-81fa-ac17c639f964 could not be found. Mar 30 07:21:51.925766 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Returning 404 to user: Instance 14430ed1-6f8f-4808-81fa-ac17c639f964 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:21:51.926603 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2f11555c-a902-4ae6-beca-549b5e1de931 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 404 len: 111 microversion: 2.1 time: 0.029878 Mar 30 07:21:51.926888 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-29ff43ba-702d-4a86-ae04-298f75015e83 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:51.927580 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 366/710] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:51 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:51.928291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-29ff43ba-702d-4a86-ae04-298f75015e83 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:51.928940 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-29ff43ba-702d-4a86-ae04-298f75015e83 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:51.936712 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ba0c296e-5577-4bad-b7a3-f3de9d241bd1 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '.version_select at 0x7f154cee1c10>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:51.958474 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ba0c296e-5577-4bad-b7a3-f3de9d241bd1 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503434125" status: 202 len: 0 microversion: 2.1 time: 0.026499 Mar 30 07:21:51.959085 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 367/711] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Mar 30 07:21:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503434125 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 30 07:21:52.126205 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-29ff43ba-702d-4a86-ae04-298f75015e83 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "POST /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd/action" status: 202 len: 0 microversion: 2.1 time: 0.222071 Mar 30 07:21:52.127054 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 345/712] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:21:51 2022] POST /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 30 07:21:52.135662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-56db3862-fd1a-432e-b93f-747ea450e505 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:52.144754 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-56db3862-fd1a-432e-b93f-747ea450e505 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:52.151634 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56db3862-fd1a-432e-b93f-747ea450e505 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:52.152298 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56db3862-fd1a-432e-b93f-747ea450e505 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:52.153253 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56db3862-fd1a-432e-b93f-747ea450e505 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:52.153844 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56db3862-fd1a-432e-b93f-747ea450e505 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:52.329406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-56db3862-fd1a-432e-b93f-747ea450e505 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:52.337441 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-56db3862-fd1a-432e-b93f-747ea450e505 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1518 microversion: 2.1 time: 0.205810 Mar 30 07:21:52.338006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 368/713] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:52 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1518 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:52.777265 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-65b771c5-8e41-4bb0-b172-f26450b195c8 req-1407a18b-451e-41e6-a912-d3109a3e6137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770fd40-dd13-44c5-a045-2552bc5420dd", "name": "network-vif-unplugged", "status": "completed", "tag": "2b0baaac-04a3-4147-9d07-17d4bc9c6c36"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:21:52.786366 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-65b771c5-8e41-4bb0-b172-f26450b195c8 req-1407a18b-451e-41e6-a912-d3109a3e6137 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:52.786951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-65b771c5-8e41-4bb0-b172-f26450b195c8 req-1407a18b-451e-41e6-a912-d3109a3e6137 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:52.798050 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.compute.server_external_events [req-65b771c5-8e41-4bb0-b172-f26450b195c8 req-1407a18b-451e-41e6-a912-d3109a3e6137 service nova] Unable to find a host for instance 1770fd40-dd13-44c5-a045-2552bc5420dd. Dropping event network-vif-unplugged {{(pid=117063) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 30 07:21:52.798940 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-65b771c5-8e41-4bb0-b172-f26450b195c8 req-1407a18b-451e-41e6-a912-d3109a3e6137 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026270 Mar 30 07:21:52.799537 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 346/714] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 30 07:21:53.355999 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7403e88c-97cd-4c10-bfc2-b84cef0eea6a tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:53.356807 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7403e88c-97cd-4c10-bfc2-b84cef0eea6a tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:53.363956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7403e88c-97cd-4c10-bfc2-b84cef0eea6a tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:53.364451 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7403e88c-97cd-4c10-bfc2-b84cef0eea6a tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:53.365504 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7403e88c-97cd-4c10-bfc2-b84cef0eea6a tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:53.367068 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7403e88c-97cd-4c10-bfc2-b84cef0eea6a tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:53.515274 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7403e88c-97cd-4c10-bfc2-b84cef0eea6a tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:53.524675 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7403e88c-97cd-4c10-bfc2-b84cef0eea6a tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1520 microversion: 2.1 time: 0.173742 Mar 30 07:21:53.525246 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 369/715] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:53 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:54.541934 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-99e928f1-2de2-4547-ab6f-dd72e10ec10c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:54.542556 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-99e928f1-2de2-4547-ab6f-dd72e10ec10c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:54.549552 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-99e928f1-2de2-4547-ab6f-dd72e10ec10c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:54.550274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-99e928f1-2de2-4547-ab6f-dd72e10ec10c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:54.551220 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-99e928f1-2de2-4547-ab6f-dd72e10ec10c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:54.551625 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-99e928f1-2de2-4547-ab6f-dd72e10ec10c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:54.762498 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-99e928f1-2de2-4547-ab6f-dd72e10ec10c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:54.770759 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-99e928f1-2de2-4547-ab6f-dd72e10ec10c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.232562 Mar 30 07:21:54.771418 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 347/716] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:54 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:54.917889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:54.918935 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:54.925707 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:54.926185 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:54.926945 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:54.927373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:54.940922 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] HTTP exception thrown: Instance 14430ed1-6f8f-4808-81fa-ac17c639f964 could not be found. Mar 30 07:21:54.941509 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Returning 404 to user: Instance 14430ed1-6f8f-4808-81fa-ac17c639f964 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:21:54.942341 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d9ff4f8d-b4b7-44fd-bc37-d6b57dee7c12 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 404 len: 111 microversion: 2.1 time: 0.028446 Mar 30 07:21:54.942870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 370/717] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:21:54 2022] DELETE /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:54.951255 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:54.951915 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: 14430ed1-6f8f-4808-81fa-ac17c639f964] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:54.958127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:54.958530 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:54.959325 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:54.959752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:54.973279 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] HTTP exception thrown: Instance 14430ed1-6f8f-4808-81fa-ac17c639f964 could not be found. Mar 30 07:21:54.973867 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Returning 404 to user: Instance 14430ed1-6f8f-4808-81fa-ac17c639f964 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:21:54.975086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-18bbbf8d-e883-4141-8121-41a3901dd2b4 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964" status: 404 len: 111 microversion: 2.1 time: 0.027491 Mar 30 07:21:54.975742 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 348/718] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:54 2022] GET /compute/v2.1/servers/14430ed1-6f8f-4808-81fa-ac17c639f964 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:55.787351 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-26acf651-81eb-4a64-872e-26939467d698 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:55.787995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-26acf651-81eb-4a64-872e-26939467d698 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:55.793985 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-26acf651-81eb-4a64-872e-26939467d698 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:55.794436 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-26acf651-81eb-4a64-872e-26939467d698 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:55.795206 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-26acf651-81eb-4a64-872e-26939467d698 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:55.795635 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-26acf651-81eb-4a64-872e-26939467d698 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:55.948934 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-26acf651-81eb-4a64-872e-26939467d698 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:55.955660 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-26acf651-81eb-4a64-872e-26939467d698 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.172255 Mar 30 07:21:55.956345 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 371/719] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:55 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:21:56.124232 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:56.124753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:56.131463 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:56.132016 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:56.132906 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:56.133352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:56.146892 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] HTTP exception thrown: Instance ea531783-864c-44f2-9311-d1939a112f2b could not be found. Mar 30 07:21:56.147637 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Returning 404 to user: Instance ea531783-864c-44f2-9311-d1939a112f2b could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:21:56.148723 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c02574d7-7960-4f05-b42b-a92e7f0363dc tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 404 len: 111 microversion: 2.1 time: 0.028539 Mar 30 07:21:56.149253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 349/720] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:21:56 2022] DELETE /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:56.157341 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:56.157960 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] [instance: ea531783-864c-44f2-9311-d1939a112f2b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:56.164456 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:56.164910 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:56.165688 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:56.166123 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:56.179583 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] HTTP exception thrown: Instance ea531783-864c-44f2-9311-d1939a112f2b could not be found. Mar 30 07:21:56.180202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] Returning 404 to user: Instance ea531783-864c-44f2-9311-d1939a112f2b could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:21:56.181032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ebc94473-59b2-4f82-872e-2350b565aaf2 tempest-AttachVolumeTestJSON-1812617836 tempest-AttachVolumeTestJSON-1812617836-project] 10.222.0.20 "GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b" status: 404 len: 111 microversion: 2.1 time: 0.027590 Mar 30 07:21:56.181548 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 372/721] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:56 2022] GET /compute/v2.1/servers/ea531783-864c-44f2-9311-d1939a112f2b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:56.973834 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-40f35a86-e7fa-4411-927f-5e8f9ebcb8cb tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:56.974753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-40f35a86-e7fa-4411-927f-5e8f9ebcb8cb tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:56.982729 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-40f35a86-e7fa-4411-927f-5e8f9ebcb8cb tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:56.983241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-40f35a86-e7fa-4411-927f-5e8f9ebcb8cb tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:56.984203 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-40f35a86-e7fa-4411-927f-5e8f9ebcb8cb tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:56.984839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-40f35a86-e7fa-4411-927f-5e8f9ebcb8cb tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:57.126957 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-40f35a86-e7fa-4411-927f-5e8f9ebcb8cb tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:57.135756 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-40f35a86-e7fa-4411-927f-5e8f9ebcb8cb tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.165781 Mar 30 07:21:57.136366 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 350/722] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:56 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:58.158074 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-8b58fb08-71d6-477b-bd37-831af67d242b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:58.160349 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-8b58fb08-71d6-477b-bd37-831af67d242b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:58.167518 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8b58fb08-71d6-477b-bd37-831af67d242b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:58.167985 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8b58fb08-71d6-477b-bd37-831af67d242b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:58.168913 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8b58fb08-71d6-477b-bd37-831af67d242b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:58.169805 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-8b58fb08-71d6-477b-bd37-831af67d242b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:58.495532 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-8b58fb08-71d6-477b-bd37-831af67d242b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:58.503520 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-8b58fb08-71d6-477b-bd37-831af67d242b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.351352 Mar 30 07:21:58.504118 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 373/723] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:58 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:21:59.523863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0f6b79a1-aed3-400c-9f70-add72ec07dd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:21:59.525983 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0f6b79a1-aed3-400c-9f70-add72ec07dd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:21:59.532973 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0f6b79a1-aed3-400c-9f70-add72ec07dd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:59.533356 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0f6b79a1-aed3-400c-9f70-add72ec07dd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:59.534125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0f6b79a1-aed3-400c-9f70-add72ec07dd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:21:59.534553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0f6b79a1-aed3-400c-9f70-add72ec07dd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:21:59.735951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0f6b79a1-aed3-400c-9f70-add72ec07dd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:21:59.744977 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0f6b79a1-aed3-400c-9f70-add72ec07dd1 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.227504 Mar 30 07:21:59.747133 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 351/724] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:21:59 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:00.763486 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-cec6699c-05d4-4cff-be94-380cb2074ffd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:00.764850 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-cec6699c-05d4-4cff-be94-380cb2074ffd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:00.774233 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cec6699c-05d4-4cff-be94-380cb2074ffd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:00.775303 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cec6699c-05d4-4cff-be94-380cb2074ffd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:00.776121 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cec6699c-05d4-4cff-be94-380cb2074ffd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:00.776559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cec6699c-05d4-4cff-be94-380cb2074ffd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:00.972840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-cec6699c-05d4-4cff-be94-380cb2074ffd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:00.981070 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-cec6699c-05d4-4cff-be94-380cb2074ffd tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.221717 Mar 30 07:22:00.981622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 374/725] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:00 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:01.997902 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d731427c-3ab5-4a34-ae3d-1d9d84f164bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:01.999616 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d731427c-3ab5-4a34-ae3d-1d9d84f164bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:02.006135 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d731427c-3ab5-4a34-ae3d-1d9d84f164bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:02.007964 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d731427c-3ab5-4a34-ae3d-1d9d84f164bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:02.008831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d731427c-3ab5-4a34-ae3d-1d9d84f164bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:02.009298 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d731427c-3ab5-4a34-ae3d-1d9d84f164bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:02.151686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d731427c-3ab5-4a34-ae3d-1d9d84f164bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:02.159276 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d731427c-3ab5-4a34-ae3d-1d9d84f164bf tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.165446 Mar 30 07:22:02.159851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 352/726] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:01 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:03.177232 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-acfe6d50-2cbd-44ea-b830-149ee0e7aa98 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:03.178574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-acfe6d50-2cbd-44ea-b830-149ee0e7aa98 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:03.192248 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-acfe6d50-2cbd-44ea-b830-149ee0e7aa98 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:03.192696 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-acfe6d50-2cbd-44ea-b830-149ee0e7aa98 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:03.193490 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-acfe6d50-2cbd-44ea-b830-149ee0e7aa98 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:03.195348 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-acfe6d50-2cbd-44ea-b830-149ee0e7aa98 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:03.497646 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-acfe6d50-2cbd-44ea-b830-149ee0e7aa98 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:03.505692 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-acfe6d50-2cbd-44ea-b830-149ee0e7aa98 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.332911 Mar 30 07:22:03.516400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 375/727] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:03 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:04.523987 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-648d2d97-12aa-45f4-8cb9-63fbbbdfc586 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:04.525249 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-648d2d97-12aa-45f4-8cb9-63fbbbdfc586 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:04.537366 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-648d2d97-12aa-45f4-8cb9-63fbbbdfc586 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:04.538345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-648d2d97-12aa-45f4-8cb9-63fbbbdfc586 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:04.544569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-648d2d97-12aa-45f4-8cb9-63fbbbdfc586 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:04.545259 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-648d2d97-12aa-45f4-8cb9-63fbbbdfc586 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:04.851415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-648d2d97-12aa-45f4-8cb9-63fbbbdfc586 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:04.861544 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-648d2d97-12aa-45f4-8cb9-63fbbbdfc586 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.342315 Mar 30 07:22:04.862223 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 353/728] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:04 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:05.419657 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-5a1e0ed1-b4b1-47c3-b3de-e6353a965592 req-73364e30-5b0d-4579-9f75-95b7dcbcd2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770fd40-dd13-44c5-a045-2552bc5420dd", "name": "network-vif-plugged", "status": "completed", "tag": "2b0baaac-04a3-4147-9d07-17d4bc9c6c36"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:05.436009 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-5a1e0ed1-b4b1-47c3-b3de-e6353a965592 req-73364e30-5b0d-4579-9f75-95b7dcbcd2c9 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:05.436885 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-5a1e0ed1-b4b1-47c3-b3de-e6353a965592 req-73364e30-5b0d-4579-9f75-95b7dcbcd2c9 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:05.469647 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-5a1e0ed1-b4b1-47c3-b3de-e6353a965592 req-73364e30-5b0d-4579-9f75-95b7dcbcd2c9 service nova] Creating event network-vif-plugged:2b0baaac-04a3-4147-9d07-17d4bc9c6c36 for instance 1770fd40-dd13-44c5-a045-2552bc5420dd on hv-cinder-83577 Mar 30 07:22:05.498586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-5a1e0ed1-b4b1-47c3-b3de-e6353a965592 req-73364e30-5b0d-4579-9f75-95b7dcbcd2c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080289 Mar 30 07:22:05.502651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 376/729] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:05.879683 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9f441930-68a4-4f3e-b164-90e484a9b95b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:05.880843 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9f441930-68a4-4f3e-b164-90e484a9b95b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:05.897304 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f441930-68a4-4f3e-b164-90e484a9b95b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:05.899755 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f441930-68a4-4f3e-b164-90e484a9b95b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:05.900648 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f441930-68a4-4f3e-b164-90e484a9b95b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:05.903556 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f441930-68a4-4f3e-b164-90e484a9b95b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:06.226519 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9f441930-68a4-4f3e-b164-90e484a9b95b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:06.239827 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9f441930-68a4-4f3e-b164-90e484a9b95b tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1576 microversion: 2.1 time: 0.361628 Mar 30 07:22:06.240501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 354/730] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:05 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1576 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:07.259959 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f4b82c19-7182-427d-9c43-5e4564866074 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:07.261404 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f4b82c19-7182-427d-9c43-5e4564866074 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:07.278937 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f4b82c19-7182-427d-9c43-5e4564866074 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:07.279664 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f4b82c19-7182-427d-9c43-5e4564866074 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:07.281011 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f4b82c19-7182-427d-9c43-5e4564866074 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:07.282158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f4b82c19-7182-427d-9c43-5e4564866074 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:07.750008 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-f4b82c19-7182-427d-9c43-5e4564866074 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:07.759503 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f4b82c19-7182-427d-9c43-5e4564866074 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1563 microversion: 2.1 time: 0.504559 Mar 30 07:22:07.760767 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 377/731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:07 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1563 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:08.019552 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fe12249b-53b1-4ae2-9eea-d602dc709580 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: .version_select at 0x7f153fe86b80>, body: {"keypair": {"name": "tempest-keypair-482107491"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:08.041877 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-fe12249b-53b1-4ae2-9eea-d602dc709580 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:22:08.052726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-fe12249b-53b1-4ae2-9eea-d602dc709580 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:22:08.579571 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-fe12249b-53b1-4ae2-9eea-d602dc709580 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:22:08.584047 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-fe12249b-53b1-4ae2-9eea-d602dc709580 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:22:08.603964 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fe12249b-53b1-4ae2-9eea-d602dc709580 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.724010 Mar 30 07:22:08.604889 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 355/732] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:22:07 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:10.573111 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1594335260", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73dd56e2-c247-440c-aa55-c3633a082de7"}], "security_groups": [{"name": "tempest-securitygroup--20860806"}], "key_name": "tempest-keypair-482107491", "user_data": "}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:10.700239 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] validate_networks() for [('73dd56e2-c247-440c-aa55-c3633a082de7', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:22:11.302296 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:22:11.302811 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:22:11.303381 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:22:11.304216 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:22:11.305048 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:22:11.316328 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:11.317120 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:11.318290 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:11.319021 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:11.340017 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:22:11.346785 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:22:11.361003 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:22:11.364420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:22:11.440026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-29859322-4dd8-4dd7-9f37-db58f8c92416 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.871031 Mar 30 07:22:11.448874 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 378/733] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:22:10 2022] POST /compute/v2.1/servers => generated 400 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:22:11.453883 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-706c260b-f601-49c3-a932-8072b218245b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:11.454516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-706c260b-f601-49c3-a932-8072b218245b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:11.573298 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-706c260b-f601-49c3-a932-8072b218245b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:11.587148 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-706c260b-f601-49c3-a932-8072b218245b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1241 microversion: 2.1 time: 0.137847 Mar 30 07:22:11.596100 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 356/734] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:11 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1241 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:12.507127 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f613285b-0676-45ae-9d87-d98b9adf4863 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:12.508672 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f613285b-0676-45ae-9d87-d98b9adf4863 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:12.530704 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f613285b-0676-45ae-9d87-d98b9adf4863 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:12.531548 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f613285b-0676-45ae-9d87-d98b9adf4863 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:12.532608 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f613285b-0676-45ae-9d87-d98b9adf4863 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:12.533260 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f613285b-0676-45ae-9d87-d98b9adf4863 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:12.611327 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e7c5ee8a-9660-471e-b63d-980fd65b2d34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:12.614258 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e7c5ee8a-9660-471e-b63d-980fd65b2d34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:12.628448 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f613285b-0676-45ae-9d87-d98b9adf4863 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.118639 Mar 30 07:22:12.630432 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 379/735] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Mar 30 07:22:12 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:12.632458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e7c5ee8a-9660-471e-b63d-980fd65b2d34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:12.633224 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e7c5ee8a-9660-471e-b63d-980fd65b2d34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:12.634233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e7c5ee8a-9660-471e-b63d-980fd65b2d34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:12.634890 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e7c5ee8a-9660-471e-b63d-980fd65b2d34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:12.735912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-27754ba5-4e09-4756-ad08-aac9c1ff7673 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:12.736463 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-27754ba5-4e09-4756-ad08-aac9c1ff7673 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:12.745281 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27754ba5-4e09-4756-ad08-aac9c1ff7673 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:12.745998 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27754ba5-4e09-4756-ad08-aac9c1ff7673 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:12.747128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27754ba5-4e09-4756-ad08-aac9c1ff7673 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:12.751316 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27754ba5-4e09-4756-ad08-aac9c1ff7673 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:12.790230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-27754ba5-4e09-4756-ad08-aac9c1ff7673 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:22:12.844748 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e7c5ee8a-9660-471e-b63d-980fd65b2d34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:12.860201 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e7c5ee8a-9660-471e-b63d-980fd65b2d34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1293 microversion: 2.1 time: 0.253373 Mar 30 07:22:12.876176 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 357/736] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:12 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1293 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:12.985900 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-27754ba5-4e09-4756-ad08-aac9c1ff7673 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 204 len: 0 microversion: 2.20 time: 0.254208 Mar 30 07:22:12.992130 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 380/737] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Mar 30 07:22:12 2022] DELETE /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 30 07:22:12.997630 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:12.998297 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:13.010608 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:13.012553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:13.019037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:13.019758 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:13.511946 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:13.534311 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:13.536156 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:13.538233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f17efb19-d24f-440f-9230-3fe0aa484a15 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.545926 Mar 30 07:22:13.539499 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 358/738] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:22:12 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:22:13.882808 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b6d48950-1609-4072-981c-ca36a2133803 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:13.884159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b6d48950-1609-4072-981c-ca36a2133803 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:13.893032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b6d48950-1609-4072-981c-ca36a2133803 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:13.898618 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b6d48950-1609-4072-981c-ca36a2133803 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:13.899751 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b6d48950-1609-4072-981c-ca36a2133803 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:13.900368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b6d48950-1609-4072-981c-ca36a2133803 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:14.388126 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b6d48950-1609-4072-981c-ca36a2133803 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:14.402050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b6d48950-1609-4072-981c-ca36a2133803 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1299 microversion: 2.1 time: 0.523874 Mar 30 07:22:14.403237 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 381/739] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:13 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1299 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:14.562122 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:14.565653 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:14.573502 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:14.574193 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:14.575134 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:14.575714 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:14.957642 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:14.975445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:14.978388 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:14.980042 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b51f55ec-5dfe-4e0e-8021-8fa53b307d10 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1725 microversion: 2.20 time: 0.426687 Mar 30 07:22:14.981896 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 359/740] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:22:14 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1725 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:22:15.420799 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7fce1a0d-91d0-4dc6-8bb5-401b9ab9e6cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:15.421758 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7fce1a0d-91d0-4dc6-8bb5-401b9ab9e6cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:15.442530 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7fce1a0d-91d0-4dc6-8bb5-401b9ab9e6cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:15.443579 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7fce1a0d-91d0-4dc6-8bb5-401b9ab9e6cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:15.444727 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7fce1a0d-91d0-4dc6-8bb5-401b9ab9e6cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:15.445282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7fce1a0d-91d0-4dc6-8bb5-401b9ab9e6cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:16.000706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:16.001907 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:16.002479 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7fce1a0d-91d0-4dc6-8bb5-401b9ab9e6cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:16.014599 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:16.015307 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:16.016382 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:16.017050 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:16.017482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7fce1a0d-91d0-4dc6-8bb5-401b9ab9e6cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.601883 Mar 30 07:22:16.018633 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 382/741] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:15 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:16.128192 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-a6b7ddd2-5d17-4111-be19-502d57b74e42 req-c3613630-8d71-4a98-8ed2-1158d90074b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e370a461-4e4d-4b34-87f6-fe6e3ba548b6", "name": "network-vif-deleted", "tag": "e4a2a22a-64df-4018-a002-940abcd5bbba"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:16.140482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a6b7ddd2-5d17-4111-be19-502d57b74e42 req-c3613630-8d71-4a98-8ed2-1158d90074b8 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:16.142944 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a6b7ddd2-5d17-4111-be19-502d57b74e42 req-c3613630-8d71-4a98-8ed2-1158d90074b8 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:16.197482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-a6b7ddd2-5d17-4111-be19-502d57b74e42 req-c3613630-8d71-4a98-8ed2-1158d90074b8 service nova] Creating event network-vif-deleted:e4a2a22a-64df-4018-a002-940abcd5bbba for instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 on hv-cinder-83577 Mar 30 07:22:16.232176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-a6b7ddd2-5d17-4111-be19-502d57b74e42 req-c3613630-8d71-4a98-8ed2-1158d90074b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102576 Mar 30 07:22:16.240835 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 383/742] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:16.369501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:16.386686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:16.388128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93c4c81f994a48feb4d712c6b5120996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee09b83520e4e8ba691a79d60604388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:16.389293 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-41dce350-f4e4-4486-8cf9-9c9a586f9397 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 200 len: 1657 microversion: 2.20 time: 0.393208 Mar 30 07:22:16.391182 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 360/743] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:22:15 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 1657 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 30 07:22:17.035168 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-102345e9-99a1-4a1a-bdb2-30ee88553e84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:17.036646 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-102345e9-99a1-4a1a-bdb2-30ee88553e84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:17.055927 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-102345e9-99a1-4a1a-bdb2-30ee88553e84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:17.056694 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-102345e9-99a1-4a1a-bdb2-30ee88553e84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:17.057716 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-102345e9-99a1-4a1a-bdb2-30ee88553e84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:17.058374 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-102345e9-99a1-4a1a-bdb2-30ee88553e84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:17.309571 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-102345e9-99a1-4a1a-bdb2-30ee88553e84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:17.317769 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-102345e9-99a1-4a1a-bdb2-30ee88553e84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.286851 Mar 30 07:22:17.318639 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 384/744] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:17 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:17.412218 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:17.413839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:17.425423 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:17.425798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:17.426726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:17.427184 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:17.445478 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] HTTP exception thrown: Instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 could not be found. Mar 30 07:22:17.446337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Returning 404 to user: Instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:22:17.447621 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0e99de53-4dfa-47f9-a34f-e20333b221e2 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 404 len: 111 microversion: 2.20 time: 0.041239 Mar 30 07:22:17.448681 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 361/745] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:22:17 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:22:17.458720 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ce671db0-4c60-45c8-a23d-f963feb3d83e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '.version_select at 0x7f154ce84040>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:17.484991 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ce671db0-4c60-45c8-a23d-f963feb3d83e tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754541589" status: 204 len: 0 microversion: 2.20 time: 0.031235 Mar 30 07:22:17.485923 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 385/746] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Mar 30 07:22:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754541589 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 30 07:22:17.510673 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-2e54e28e-0fe9-4630-8cbd-d7886c10cd4f req-c8f2ae0a-013f-4cbf-bfd5-1038e0352f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb553a5a-a341-4f34-9d09-4082d87fc076", "tag": "8f177682-1cd3-4432-bdc9-dd65cf3fa601"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:17.519662 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-2e54e28e-0fe9-4630-8cbd-d7886c10cd4f req-c8f2ae0a-013f-4cbf-bfd5-1038e0352f63 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:17.520377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-2e54e28e-0fe9-4630-8cbd-d7886c10cd4f req-c8f2ae0a-013f-4cbf-bfd5-1038e0352f63 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:17.541797 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-2e54e28e-0fe9-4630-8cbd-d7886c10cd4f req-c8f2ae0a-013f-4cbf-bfd5-1038e0352f63 service nova] Creating event network-changed:8f177682-1cd3-4432-bdc9-dd65cf3fa601 for instance fb553a5a-a341-4f34-9d09-4082d87fc076 on hv-cinder-83577 Mar 30 07:22:17.549186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-2e54e28e-0fe9-4630-8cbd-d7886c10cd4f req-c8f2ae0a-013f-4cbf-bfd5-1038e0352f63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041323 Mar 30 07:22:17.550152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 362/747] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:18.336462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4255b9ac-4bb3-40db-81a1-c2118f83e682 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:18.337135 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4255b9ac-4bb3-40db-81a1-c2118f83e682 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:18.346486 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4255b9ac-4bb3-40db-81a1-c2118f83e682 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:18.346940 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4255b9ac-4bb3-40db-81a1-c2118f83e682 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:18.347731 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4255b9ac-4bb3-40db-81a1-c2118f83e682 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:18.348204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4255b9ac-4bb3-40db-81a1-c2118f83e682 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:18.902622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-4255b9ac-4bb3-40db-81a1-c2118f83e682 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:18.913752 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4255b9ac-4bb3-40db-81a1-c2118f83e682 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.582271 Mar 30 07:22:18.925509 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 386/748] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:18 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:19.583979 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:19.584710 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:19.598367 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:19.598816 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:19.599607 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:19.600243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:19.631846 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] HTTP exception thrown: Instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 could not be found. Mar 30 07:22:19.633360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Returning 404 to user: Instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:22:19.634529 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4cbcf65e-6896-401d-85d5-4af5181380b8 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 404 len: 111 microversion: 2.20 time: 0.055347 Mar 30 07:22:19.636043 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 363/749] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Mar 30 07:22:19 2022] DELETE /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:22:19.649012 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:19.650882 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: e370a461-4e4d-4b34-87f6-fe6e3ba548b6] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:19.668324 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:19.668788 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:19.669751 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:19.670376 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:19.687247 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] HTTP exception thrown: Instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 could not be found. Mar 30 07:22:19.688329 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Returning 404 to user: Instance e370a461-4e4d-4b34-87f6-fe6e3ba548b6 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:22:19.689349 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-65ff9c15-d6dc-4a11-9284-56c4d931b4e7 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6" status: 404 len: 111 microversion: 2.20 time: 0.045359 Mar 30 07:22:19.690476 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 387/750] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:22:19 2022] GET /compute/v2.1/servers/e370a461-4e4d-4b34-87f6-fe6e3ba548b6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:22:19.934702 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6148c16f-4d88-4700-ad00-a8a7c71f8b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:19.935581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6148c16f-4d88-4700-ad00-a8a7c71f8b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:19.945968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6148c16f-4d88-4700-ad00-a8a7c71f8b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:19.947680 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6148c16f-4d88-4700-ad00-a8a7c71f8b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:19.948903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6148c16f-4d88-4700-ad00-a8a7c71f8b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:19.949989 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6148c16f-4d88-4700-ad00-a8a7c71f8b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:20.153798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6148c16f-4d88-4700-ad00-a8a7c71f8b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:20.164169 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6148c16f-4d88-4700-ad00-a8a7c71f8b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.235507 Mar 30 07:22:20.164424 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 364/751] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:19 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:20.850320 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:20.850958 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:20.858418 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:20.858861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:20.859656 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:20.860112 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:20.875205 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] HTTP exception thrown: Instance d977a73f-876d-4d10-adf8-326ed77fc467 could not be found. Mar 30 07:22:20.875822 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Returning 404 to user: Instance d977a73f-876d-4d10-adf8-326ed77fc467 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:22:20.876695 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b8d2d97b-59ad-4c01-b798-07d17a6bded3 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 404 len: 111 microversion: 2.20 time: 0.030851 Mar 30 07:22:20.877521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 388/752] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Mar 30 07:22:20 2022] DELETE /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:22:20.885882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:20.886488 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] [instance: d977a73f-876d-4d10-adf8-326ed77fc467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:20.893263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:20.893718 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:20.894521 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:20.894920 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:20.910067 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] HTTP exception thrown: Instance d977a73f-876d-4d10-adf8-326ed77fc467 could not be found. Mar 30 07:22:20.910670 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] Returning 404 to user: Instance d977a73f-876d-4d10-adf8-326ed77fc467 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:22:20.911549 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0438da64-08de-4fcb-a16f-870de67e1b74 tempest-AttachVolumeShelveTestJSON-1548481741 tempest-AttachVolumeShelveTestJSON-1548481741-project] 10.222.0.20 "GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467" status: 404 len: 111 microversion: 2.20 time: 0.029859 Mar 30 07:22:20.912224 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 365/753] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Mar 30 07:22:20 2022] GET /compute/v2.1/servers/d977a73f-876d-4d10-adf8-326ed77fc467 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:22:21.181698 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d5743054-9903-43ef-a334-1e3588cd74ab tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:21.182325 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d5743054-9903-43ef-a334-1e3588cd74ab tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:21.194443 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d5743054-9903-43ef-a334-1e3588cd74ab tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:21.195280 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d5743054-9903-43ef-a334-1e3588cd74ab tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:21.196423 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d5743054-9903-43ef-a334-1e3588cd74ab tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:21.197158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d5743054-9903-43ef-a334-1e3588cd74ab tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:21.356074 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d5743054-9903-43ef-a334-1e3588cd74ab tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:21.365522 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d5743054-9903-43ef-a334-1e3588cd74ab tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.188065 Mar 30 07:22:21.366662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 389/754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:21 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:22.382103 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-07416c75-ff5f-48db-8293-bb1cc7d9181b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:22.382631 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-07416c75-ff5f-48db-8293-bb1cc7d9181b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:22.391306 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-07416c75-ff5f-48db-8293-bb1cc7d9181b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:22.391746 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-07416c75-ff5f-48db-8293-bb1cc7d9181b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:22.392754 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-07416c75-ff5f-48db-8293-bb1cc7d9181b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:22.393263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-07416c75-ff5f-48db-8293-bb1cc7d9181b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:22.574150 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-07416c75-ff5f-48db-8293-bb1cc7d9181b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:22.582175 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-07416c75-ff5f-48db-8293-bb1cc7d9181b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.204255 Mar 30 07:22:22.583925 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 366/755] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:22 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:23.600092 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-836fec6b-a5e0-47cb-a9ee-17b67ce200dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:23.601044 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-836fec6b-a5e0-47cb-a9ee-17b67ce200dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:23.607567 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-836fec6b-a5e0-47cb-a9ee-17b67ce200dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:23.621510 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-836fec6b-a5e0-47cb-a9ee-17b67ce200dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:23.622511 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-836fec6b-a5e0-47cb-a9ee-17b67ce200dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:23.622958 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-836fec6b-a5e0-47cb-a9ee-17b67ce200dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:23.737029 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-25f8088c-4893-42ca-8354-937a11bfbf2a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:23.738983 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-25f8088c-4893-42ca-8354-937a11bfbf2a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:23.751946 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-25f8088c-4893-42ca-8354-937a11bfbf2a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:23.754758 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-25f8088c-4893-42ca-8354-937a11bfbf2a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:23.758928 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-25f8088c-4893-42ca-8354-937a11bfbf2a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:23.761297 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-25f8088c-4893-42ca-8354-937a11bfbf2a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:23.821665 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-25f8088c-4893-42ca-8354-937a11bfbf2a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:22:24.017341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-25f8088c-4893-42ca-8354-937a11bfbf2a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 204 len: 0 microversion: 2.1 time: 0.285165 Mar 30 07:22:24.022986 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 367/756] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:22:23 2022] DELETE /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:22:24.030836 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5326f73d-2092-4391-bbb2-33d8b317f866 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:24.031695 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5326f73d-2092-4391-bbb2-33d8b317f866 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:24.045275 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5326f73d-2092-4391-bbb2-33d8b317f866 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:24.045984 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5326f73d-2092-4391-bbb2-33d8b317f866 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:24.047689 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5326f73d-2092-4391-bbb2-33d8b317f866 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:24.048428 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5326f73d-2092-4391-bbb2-33d8b317f866 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:24.054016 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-836fec6b-a5e0-47cb-a9ee-17b67ce200dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:24.065588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-836fec6b-a5e0-47cb-a9ee-17b67ce200dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.469502 Mar 30 07:22:24.067714 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 390/757] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:23 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:24.498944 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5326f73d-2092-4391-bbb2-33d8b317f866 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:24.515952 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5326f73d-2092-4391-bbb2-33d8b317f866 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1579 microversion: 2.1 time: 0.488748 Mar 30 07:22:24.515952 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 368/758] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:24 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1579 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:25.083128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2d3da8e4-03f9-494f-896c-82c2bf83c1c3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:25.084063 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2d3da8e4-03f9-494f-896c-82c2bf83c1c3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:25.101140 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2d3da8e4-03f9-494f-896c-82c2bf83c1c3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:25.101681 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2d3da8e4-03f9-494f-896c-82c2bf83c1c3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:25.103145 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2d3da8e4-03f9-494f-896c-82c2bf83c1c3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:25.103571 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2d3da8e4-03f9-494f-896c-82c2bf83c1c3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:25.329250 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2d3da8e4-03f9-494f-896c-82c2bf83c1c3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:25.345245 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2d3da8e4-03f9-494f-896c-82c2bf83c1c3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.266349 Mar 30 07:22:25.347781 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 391/759] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:25 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:25.533103 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1a62a1df-fdb3-405d-8f97-8b6416ab1085 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:25.533721 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1a62a1df-fdb3-405d-8f97-8b6416ab1085 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:25.541217 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1a62a1df-fdb3-405d-8f97-8b6416ab1085 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:25.543709 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1a62a1df-fdb3-405d-8f97-8b6416ab1085 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:25.560788 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1a62a1df-fdb3-405d-8f97-8b6416ab1085 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:25.561529 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1a62a1df-fdb3-405d-8f97-8b6416ab1085 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:25.793939 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1a62a1df-fdb3-405d-8f97-8b6416ab1085 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:25.806368 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1a62a1df-fdb3-405d-8f97-8b6416ab1085 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1579 microversion: 2.1 time: 0.277268 Mar 30 07:22:25.820892 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 369/760] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:25 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1579 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:26.367217 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bcd3cbba-54df-47ea-ac94-5cbe5742ea53 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:26.368622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-bcd3cbba-54df-47ea-ac94-5cbe5742ea53 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:26.377265 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bcd3cbba-54df-47ea-ac94-5cbe5742ea53 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:26.377873 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bcd3cbba-54df-47ea-ac94-5cbe5742ea53 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:26.378800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bcd3cbba-54df-47ea-ac94-5cbe5742ea53 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:26.379641 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-bcd3cbba-54df-47ea-ac94-5cbe5742ea53 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:26.655110 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-bcd3cbba-54df-47ea-ac94-5cbe5742ea53 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:26.663679 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bcd3cbba-54df-47ea-ac94-5cbe5742ea53 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.302224 Mar 30 07:22:26.664313 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 392/761] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:26 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:26.835275 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-48148677-9f89-4fc2-b19c-35f8b8fff2ad tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:26.838114 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-48148677-9f89-4fc2-b19c-35f8b8fff2ad tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:26.855315 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-48148677-9f89-4fc2-b19c-35f8b8fff2ad tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:26.857319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-48148677-9f89-4fc2-b19c-35f8b8fff2ad tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:26.863347 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-48148677-9f89-4fc2-b19c-35f8b8fff2ad tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:26.867833 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-48148677-9f89-4fc2-b19c-35f8b8fff2ad tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:26.996097 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-48148677-9f89-4fc2-b19c-35f8b8fff2ad tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:27.014135 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-48148677-9f89-4fc2-b19c-35f8b8fff2ad tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1511 microversion: 2.1 time: 0.187349 Mar 30 07:22:27.014746 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 370/762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:26 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:27.065732 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-c1a7bf8a-1fcd-454b-8f3e-a337c1f2ce40 req-36379295-1a80-41ed-837d-b4cf70c90599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb553a5a-a341-4f34-9d09-4082d87fc076", "name": "network-vif-plugged", "status": "completed", "tag": "8f177682-1cd3-4432-bdc9-dd65cf3fa601"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:27.078607 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-c1a7bf8a-1fcd-454b-8f3e-a337c1f2ce40 req-36379295-1a80-41ed-837d-b4cf70c90599 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:27.079149 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-c1a7bf8a-1fcd-454b-8f3e-a337c1f2ce40 req-36379295-1a80-41ed-837d-b4cf70c90599 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:27.109551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-c1a7bf8a-1fcd-454b-8f3e-a337c1f2ce40 req-36379295-1a80-41ed-837d-b4cf70c90599 service nova] Creating event network-vif-plugged:8f177682-1cd3-4432-bdc9-dd65cf3fa601 for instance fb553a5a-a341-4f34-9d09-4082d87fc076 on hv-cinder-83577 Mar 30 07:22:27.127361 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-c1a7bf8a-1fcd-454b-8f3e-a337c1f2ce40 req-36379295-1a80-41ed-837d-b4cf70c90599 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065213 Mar 30 07:22:27.128000 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 393/763] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:27.326164 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-588c490a-4f99-4be1-9e69-a5936ccbb57d req-876c5574-ed2e-45c2-a159-ea95da09f877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a76b506-9c23-4b23-a6e2-7c35a67f853b", "name": "network-vif-deleted", "tag": "911e3e03-0ad9-43ce-ac95-4b86be14605b"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:27.346322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-588c490a-4f99-4be1-9e69-a5936ccbb57d req-876c5574-ed2e-45c2-a159-ea95da09f877 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:27.347084 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-588c490a-4f99-4be1-9e69-a5936ccbb57d req-876c5574-ed2e-45c2-a159-ea95da09f877 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:27.368919 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-588c490a-4f99-4be1-9e69-a5936ccbb57d req-876c5574-ed2e-45c2-a159-ea95da09f877 service nova] Creating event network-vif-deleted:911e3e03-0ad9-43ce-ac95-4b86be14605b for instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b on hv-cinder-83577 Mar 30 07:22:27.379859 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-588c490a-4f99-4be1-9e69-a5936ccbb57d req-876c5574-ed2e-45c2-a159-ea95da09f877 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057045 Mar 30 07:22:27.381517 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 371/764] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:27.681335 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e259c566-9d29-4dbe-bffd-34620975e0f9 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:27.682201 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e259c566-9d29-4dbe-bffd-34620975e0f9 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:27.690922 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e259c566-9d29-4dbe-bffd-34620975e0f9 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:27.695219 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e259c566-9d29-4dbe-bffd-34620975e0f9 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:27.697400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e259c566-9d29-4dbe-bffd-34620975e0f9 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:27.698067 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e259c566-9d29-4dbe-bffd-34620975e0f9 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:27.962865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e259c566-9d29-4dbe-bffd-34620975e0f9 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:27.972048 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e259c566-9d29-4dbe-bffd-34620975e0f9 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1365 microversion: 2.1 time: 0.295110 Mar 30 07:22:27.972630 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 394/765] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:27 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:28.032990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:28.033690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:28.042013 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:28.044384 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:28.046153 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:28.050971 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:28.106851 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:28.107553 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:28.108495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lazy-loading 'fault' on Instance uuid 8a76b506-9c23-4b23-a6e2-7c35a67f853b {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:22:28.164751 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:28.177267 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5f84b576-4f73-44a0-822f-d4e6eb4120ba tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 200 len: 1231 microversion: 2.1 time: 0.148439 Mar 30 07:22:28.178498 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 372/766] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:28 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 1231 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:28.991683 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2f650e22-e396-476c-8df4-7a91bb47b7dc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:28.992328 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2f650e22-e396-476c-8df4-7a91bb47b7dc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:28.999595 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f650e22-e396-476c-8df4-7a91bb47b7dc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:29.000108 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f650e22-e396-476c-8df4-7a91bb47b7dc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:29.000897 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f650e22-e396-476c-8df4-7a91bb47b7dc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:29.001325 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2f650e22-e396-476c-8df4-7a91bb47b7dc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:29.158627 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2f650e22-e396-476c-8df4-7a91bb47b7dc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:29.166933 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2f650e22-e396-476c-8df4-7a91bb47b7dc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1556 microversion: 2.1 time: 0.179449 Mar 30 07:22:29.167503 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 395/767] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:28 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:29.183728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-56ca6b58-8edb-4d1e-a363-2481d621057b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:29.184319 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-56ca6b58-8edb-4d1e-a363-2481d621057b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:29.191127 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-56ca6b58-8edb-4d1e-a363-2481d621057b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:29.191599 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-56ca6b58-8edb-4d1e-a363-2481d621057b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:29.192441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-56ca6b58-8edb-4d1e-a363-2481d621057b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:29.192863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-56ca6b58-8edb-4d1e-a363-2481d621057b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:29.196849 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:29.197791 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:29.207322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:29.208144 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:29.209178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:29.209909 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:29.225599 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] HTTP exception thrown: Instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b could not be found. Mar 30 07:22:29.226621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Returning 404 to user: Instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:22:29.236634 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4d428db3-ff14-4d1c-b064-12c4dc9054fd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 404 len: 111 microversion: 2.1 time: 0.046011 Mar 30 07:22:29.248551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 396/768] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:29 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 30 07:22:29.299924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-56ca6b58-8edb-4d1e-a363-2481d621057b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120363 Mar 30 07:22:29.300723 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 373/769] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Mar 30 07:22:29 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:29.365052 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-194044729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1669774890", "security_groups": [{"name": "tempest-secgroup-smoke-1550549607"}], "block_device_mapping_v2": [{"uuid": "41e7b478-9aaa-48c5-975f-32ede8383087", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87604e57-b8c9-45c9-ab61-2b321b1caa0c"}]}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:29.489025 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] validate_networks() for [('87604e57-b8c9-45c9-ab61-2b321b1caa0c', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:22:29.947208 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:22:29.947632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:22:29.948882 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:22:29.948882 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:22:29.949112 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:22:29.959715 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:29.960194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:29.961213 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:29.961658 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:29.985621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for project 803772b9959c49c988cb738b94678917. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:22:29.990775 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for user 38e427dd29ea4380b01a1c257cc3da00 and project 803772b9959c49c988cb738b94678917. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:22:30.065143 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:22:30.067270 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41e7b478-9aaa-48c5-975f-32ede8383087',volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:22:30.244939 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b3246436-2964-40ae-b89f-e14ebe61a70a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.885280 Mar 30 07:22:30.246345 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 397/770] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:22:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:22:30.257479 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bee8012b-ef65-4708-ad6a-3db8425400b8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:30.258094 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-bee8012b-ef65-4708-ad6a-3db8425400b8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:30.290372 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-eb41e723-5e98-4daf-88ae-a9e956057309 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Action: 'create', calling method: .version_select at 0x7f154ce84dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1446907644"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:30.315861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-eb41e723-5e98-4daf-88ae-a9e956057309 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Getting quotas for project f93c1f92c8c14564bdb5b78a2d2b8b45. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:22:30.320318 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-eb41e723-5e98-4daf-88ae-a9e956057309 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Getting quotas for user f52cc2951a1c4a11a369acd769c78db1 and project f93c1f92c8c14564bdb5b78a2d2b8b45. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:22:30.358688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-bee8012b-ef65-4708-ad6a-3db8425400b8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:30.373785 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-bee8012b-ef65-4708-ad6a-3db8425400b8 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1094 microversion: 2.1 time: 0.120839 Mar 30 07:22:30.374592 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 374/771] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:30 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1094 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:30.507454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-eb41e723-5e98-4daf-88ae-a9e956057309 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Getting quotas for project f93c1f92c8c14564bdb5b78a2d2b8b45. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:22:30.528446 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-eb41e723-5e98-4daf-88ae-a9e956057309 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Getting quotas for user f52cc2951a1c4a11a369acd769c78db1 and project f93c1f92c8c14564bdb5b78a2d2b8b45. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:22:30.552744 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-eb41e723-5e98-4daf-88ae-a9e956057309 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.271539 Mar 30 07:22:30.562317 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 398/772] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:22:30 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:22:30.714176 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1294875831", "imageRef": "740d1a87-80f9-468e-b793-e1c131428a8a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1446907644", "networks": [{"uuid": "bb4ee955-7360-4788-803d-5e6807204f1d"}]}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:30.781275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-a4a49ca3-f0a3-4156-b860-30ec5e08e88d req-ae0c94e5-e56c-4102-9bfe-b58b1612d125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb553a5a-a341-4f34-9d09-4082d87fc076", "tag": "8f177682-1cd3-4432-bdc9-dd65cf3fa601"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:30.789955 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] validate_networks() for [('bb4ee955-7360-4788-803d-5e6807204f1d', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:22:30.793541 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a4a49ca3-f0a3-4156-b860-30ec5e08e88d req-ae0c94e5-e56c-4102-9bfe-b58b1612d125 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:30.794089 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a4a49ca3-f0a3-4156-b860-30ec5e08e88d req-ae0c94e5-e56c-4102-9bfe-b58b1612d125 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:30.806553 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-a4a49ca3-f0a3-4156-b860-30ec5e08e88d req-ae0c94e5-e56c-4102-9bfe-b58b1612d125 service nova] Creating event network-changed:8f177682-1cd3-4432-bdc9-dd65cf3fa601 for instance fb553a5a-a341-4f34-9d09-4082d87fc076 on hv-cinder-83577 Mar 30 07:22:30.819327 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-a4a49ca3-f0a3-4156-b860-30ec5e08e88d req-ae0c94e5-e56c-4102-9bfe-b58b1612d125 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037577 Mar 30 07:22:30.824901 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 399/773] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:31.393934 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-75ac1b4b-0c2e-4e4f-9dfe-aaf7abfa00e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:31.394419 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-75ac1b4b-0c2e-4e4f-9dfe-aaf7abfa00e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:31.399946 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:22:31.400889 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:22:31.401534 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:22:31.401782 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-75ac1b4b-0c2e-4e4f-9dfe-aaf7abfa00e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:31.402295 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:22:31.402633 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-75ac1b4b-0c2e-4e4f-9dfe-aaf7abfa00e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:31.403126 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:22:31.403426 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-75ac1b4b-0c2e-4e4f-9dfe-aaf7abfa00e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:31.403884 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-75ac1b4b-0c2e-4e4f-9dfe-aaf7abfa00e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:31.415389 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:31.416241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:31.417277 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:31.417909 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:31.446243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Getting quotas for project f93c1f92c8c14564bdb5b78a2d2b8b45. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:22:31.451827 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Getting quotas for user f52cc2951a1c4a11a369acd769c78db1 and project f93c1f92c8c14564bdb5b78a2d2b8b45. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:22:31.470751 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:22:31.473669 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='740d1a87-80f9-468e-b793-e1c131428a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:22:31.567137 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-93d32315-1132-4587-920b-f6ad9a404cdb tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857061 Mar 30 07:22:31.577212 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 375/774] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:22:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:22:31.589522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-66df073b-7c14-49f5-b53f-04d0748ce554 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:31.590836 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-66df073b-7c14-49f5-b53f-04d0748ce554 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:31.947551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-75ac1b4b-0c2e-4e4f-9dfe-aaf7abfa00e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:31.962223 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-75ac1b4b-0c2e-4e4f-9dfe-aaf7abfa00e7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1192 microversion: 2.1 time: 0.573289 Mar 30 07:22:31.962936 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 400/775] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:31 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1192 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:22:31.968725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-66df073b-7c14-49f5-b53f-04d0748ce554 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:31.976203 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-66df073b-7c14-49f5-b53f-04d0748ce554 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1259 microversion: 2.1 time: 0.391676 Mar 30 07:22:31.976892 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 376/776] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:31 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1259 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:32.983282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-56fcbc19-58e5-4beb-88b5-5c60a610b8c7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:32.984231 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-56fcbc19-58e5-4beb-88b5-5c60a610b8c7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:32.993544 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56fcbc19-58e5-4beb-88b5-5c60a610b8c7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:32.994294 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56fcbc19-58e5-4beb-88b5-5c60a610b8c7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:32.995500 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56fcbc19-58e5-4beb-88b5-5c60a610b8c7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:32.996193 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56fcbc19-58e5-4beb-88b5-5c60a610b8c7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:32.996352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-df89dc8f-921a-48b9-a66e-e4373503a845 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:32.996935 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-df89dc8f-921a-48b9-a66e-e4373503a845 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:33.006734 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-df89dc8f-921a-48b9-a66e-e4373503a845 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:33.007102 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-df89dc8f-921a-48b9-a66e-e4373503a845 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:33.007889 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-df89dc8f-921a-48b9-a66e-e4373503a845 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:33.008338 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-df89dc8f-921a-48b9-a66e-e4373503a845 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:33.082383 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-df89dc8f-921a-48b9-a66e-e4373503a845 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:33.090324 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-df89dc8f-921a-48b9-a66e-e4373503a845 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1255 microversion: 2.1 time: 0.099885 Mar 30 07:22:33.090893 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 377/777] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:32 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1255 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:33.160384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-56fcbc19-58e5-4beb-88b5-5c60a610b8c7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:33.168495 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-56fcbc19-58e5-4beb-88b5-5c60a610b8c7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1278 microversion: 2.1 time: 0.191878 Mar 30 07:22:33.169036 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 401/778] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:32 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:34.112280 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-601ad214-c067-4f79-ae10-d84c0c13909a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:34.113274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-601ad214-c067-4f79-ae10-d84c0c13909a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:34.120871 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-601ad214-c067-4f79-ae10-d84c0c13909a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:34.121311 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-601ad214-c067-4f79-ae10-d84c0c13909a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:34.122068 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-601ad214-c067-4f79-ae10-d84c0c13909a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:34.122494 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-601ad214-c067-4f79-ae10-d84c0c13909a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:34.184944 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-601ad214-c067-4f79-ae10-d84c0c13909a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:34.190639 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0e556da9-fa23-409f-8901-5ce3a0790e4e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:34.191384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0e556da9-fa23-409f-8901-5ce3a0790e4e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:34.193375 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-601ad214-c067-4f79-ae10-d84c0c13909a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1255 microversion: 2.1 time: 0.087430 Mar 30 07:22:34.194102 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 378/779] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:34 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1255 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:34.198600 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0e556da9-fa23-409f-8901-5ce3a0790e4e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:34.199051 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0e556da9-fa23-409f-8901-5ce3a0790e4e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:34.199845 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0e556da9-fa23-409f-8901-5ce3a0790e4e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:34.200277 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0e556da9-fa23-409f-8901-5ce3a0790e4e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:34.341773 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0e556da9-fa23-409f-8901-5ce3a0790e4e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:34.349688 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0e556da9-fa23-409f-8901-5ce3a0790e4e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1278 microversion: 2.1 time: 0.162787 Mar 30 07:22:34.350464 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 402/780] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:34 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:35.215981 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-41843eb0-5f64-4572-b3e3-6b4a3ba631c5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:35.217403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-41843eb0-5f64-4572-b3e3-6b4a3ba631c5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:35.229505 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41843eb0-5f64-4572-b3e3-6b4a3ba631c5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:35.230865 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41843eb0-5f64-4572-b3e3-6b4a3ba631c5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:35.231663 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41843eb0-5f64-4572-b3e3-6b4a3ba631c5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:35.232135 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-41843eb0-5f64-4572-b3e3-6b4a3ba631c5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:35.312776 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-41843eb0-5f64-4572-b3e3-6b4a3ba631c5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:35.323794 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-41843eb0-5f64-4572-b3e3-6b4a3ba631c5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1311 microversion: 2.1 time: 0.114670 Mar 30 07:22:35.325476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 379/781] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:35 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:35.373539 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-03c32ae9-e7b9-44f8-83a2-0b10c6c7c9a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:35.374218 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-03c32ae9-e7b9-44f8-83a2-0b10c6c7c9a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:35.384932 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-03c32ae9-e7b9-44f8-83a2-0b10c6c7c9a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:35.385411 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-03c32ae9-e7b9-44f8-83a2-0b10c6c7c9a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:35.393991 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-03c32ae9-e7b9-44f8-83a2-0b10c6c7c9a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:35.399023 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-03c32ae9-e7b9-44f8-83a2-0b10c6c7c9a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:35.497383 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-7c4e0851-c612-4ce6-be8a-1320505f0fe3 req-179da1b8-a032-448c-83a7-ae2ac4134229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153dd568-5bf9-4ddc-9221-8fe74c4bd58b", "tag": "ec40b8bb-3831-42fc-bb08-d0b7a674e052"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:35.516572 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7c4e0851-c612-4ce6-be8a-1320505f0fe3 req-179da1b8-a032-448c-83a7-ae2ac4134229 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:35.517019 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7c4e0851-c612-4ce6-be8a-1320505f0fe3 req-179da1b8-a032-448c-83a7-ae2ac4134229 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:35.546875 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-7c4e0851-c612-4ce6-be8a-1320505f0fe3 req-179da1b8-a032-448c-83a7-ae2ac4134229 service nova] Creating event network-changed:ec40b8bb-3831-42fc-bb08-d0b7a674e052 for instance 153dd568-5bf9-4ddc-9221-8fe74c4bd58b on hv-cinder-83577 Mar 30 07:22:35.562712 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-7c4e0851-c612-4ce6-be8a-1320505f0fe3 req-179da1b8-a032-448c-83a7-ae2ac4134229 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071278 Mar 30 07:22:35.571905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 380/782] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:35.844949 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-03c32ae9-e7b9-44f8-83a2-0b10c6c7c9a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:35.854328 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-03c32ae9-e7b9-44f8-83a2-0b10c6c7c9a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1278 microversion: 2.1 time: 0.485526 Mar 30 07:22:35.856000 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 403/783] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:35 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1278 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:36.343860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fcfd19d5-0b89-4c41-9092-da5811d3808f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:36.344595 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-fcfd19d5-0b89-4c41-9092-da5811d3808f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:36.359287 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fcfd19d5-0b89-4c41-9092-da5811d3808f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:36.359861 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fcfd19d5-0b89-4c41-9092-da5811d3808f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:36.360739 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fcfd19d5-0b89-4c41-9092-da5811d3808f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:36.361247 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-fcfd19d5-0b89-4c41-9092-da5811d3808f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:36.650128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-fcfd19d5-0b89-4c41-9092-da5811d3808f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:36.660531 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fcfd19d5-0b89-4c41-9092-da5811d3808f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.322188 Mar 30 07:22:36.661028 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 381/784] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:36 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:36.874871 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c147d80b-4354-4fbe-b1d6-0c86bfdc59b7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:36.876379 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c147d80b-4354-4fbe-b1d6-0c86bfdc59b7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:36.887301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c147d80b-4354-4fbe-b1d6-0c86bfdc59b7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:36.888334 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c147d80b-4354-4fbe-b1d6-0c86bfdc59b7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:36.889965 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c147d80b-4354-4fbe-b1d6-0c86bfdc59b7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:36.890688 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c147d80b-4354-4fbe-b1d6-0c86bfdc59b7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:37.050865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c147d80b-4354-4fbe-b1d6-0c86bfdc59b7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:37.058709 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c147d80b-4354-4fbe-b1d6-0c86bfdc59b7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.189376 Mar 30 07:22:37.067625 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 404/785] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:36 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:37.686742 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-06269e6f-a791-4e30-8c66-995ed436282d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:37.689348 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-06269e6f-a791-4e30-8c66-995ed436282d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:37.699156 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-06269e6f-a791-4e30-8c66-995ed436282d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:37.699611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-06269e6f-a791-4e30-8c66-995ed436282d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:37.700442 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-06269e6f-a791-4e30-8c66-995ed436282d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:37.700884 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-06269e6f-a791-4e30-8c66-995ed436282d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:37.856522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-06269e6f-a791-4e30-8c66-995ed436282d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:37.864256 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-06269e6f-a791-4e30-8c66-995ed436282d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.188702 Mar 30 07:22:37.864830 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 382/786] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:37 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:38.077014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5ffaa50f-ee0c-414c-ad87-858d0663c2e0 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:38.077629 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5ffaa50f-ee0c-414c-ad87-858d0663c2e0 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:38.084332 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ffaa50f-ee0c-414c-ad87-858d0663c2e0 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:38.085127 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ffaa50f-ee0c-414c-ad87-858d0663c2e0 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:38.086439 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ffaa50f-ee0c-414c-ad87-858d0663c2e0 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:38.086855 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ffaa50f-ee0c-414c-ad87-858d0663c2e0 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:38.239136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5ffaa50f-ee0c-414c-ad87-858d0663c2e0 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:38.248359 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5ffaa50f-ee0c-414c-ad87-858d0663c2e0 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.175158 Mar 30 07:22:38.248941 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 405/787] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:38 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:38.881562 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9b0edf56-f2e2-4ae6-abc3-6ecad7f90c01 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:38.882450 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9b0edf56-f2e2-4ae6-abc3-6ecad7f90c01 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:38.889372 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9b0edf56-f2e2-4ae6-abc3-6ecad7f90c01 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:38.889865 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9b0edf56-f2e2-4ae6-abc3-6ecad7f90c01 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:38.890876 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9b0edf56-f2e2-4ae6-abc3-6ecad7f90c01 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:38.891342 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9b0edf56-f2e2-4ae6-abc3-6ecad7f90c01 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:39.062994 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9b0edf56-f2e2-4ae6-abc3-6ecad7f90c01 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:39.071269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9b0edf56-f2e2-4ae6-abc3-6ecad7f90c01 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.193618 Mar 30 07:22:39.078831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 383/788] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:38 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:22:39.265591 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9be18047-34fe-4d9e-b32a-b56499f9e700 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:39.266147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9be18047-34fe-4d9e-b32a-b56499f9e700 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:39.273135 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be18047-34fe-4d9e-b32a-b56499f9e700 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:39.273684 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be18047-34fe-4d9e-b32a-b56499f9e700 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:39.274461 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be18047-34fe-4d9e-b32a-b56499f9e700 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:39.274889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9be18047-34fe-4d9e-b32a-b56499f9e700 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:39.459931 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9be18047-34fe-4d9e-b32a-b56499f9e700 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:39.467778 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9be18047-34fe-4d9e-b32a-b56499f9e700 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.206136 Mar 30 07:22:39.468707 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 406/789] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:39 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:40.089507 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f78b8b25-08e5-4de1-a097-3b5d4be0dbd7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:40.090131 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f78b8b25-08e5-4de1-a097-3b5d4be0dbd7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:40.100610 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f78b8b25-08e5-4de1-a097-3b5d4be0dbd7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:40.101504 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f78b8b25-08e5-4de1-a097-3b5d4be0dbd7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:40.102810 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f78b8b25-08e5-4de1-a097-3b5d4be0dbd7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:40.103586 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f78b8b25-08e5-4de1-a097-3b5d4be0dbd7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:40.274814 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f78b8b25-08e5-4de1-a097-3b5d4be0dbd7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:40.284928 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f78b8b25-08e5-4de1-a097-3b5d4be0dbd7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.199751 Mar 30 07:22:40.286186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 384/790] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:40 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:40.485277 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5ebfea80-5dcc-4d63-a27c-840a05999750 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:40.485889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5ebfea80-5dcc-4d63-a27c-840a05999750 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:40.492492 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ebfea80-5dcc-4d63-a27c-840a05999750 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:40.492932 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ebfea80-5dcc-4d63-a27c-840a05999750 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:40.493702 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ebfea80-5dcc-4d63-a27c-840a05999750 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:40.494132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ebfea80-5dcc-4d63-a27c-840a05999750 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:40.677531 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5ebfea80-5dcc-4d63-a27c-840a05999750 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:40.685751 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5ebfea80-5dcc-4d63-a27c-840a05999750 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.204343 Mar 30 07:22:40.686603 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 407/791] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:40 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:22:41.302611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a31efb71-0b70-41cd-97f3-7603a5a14e60 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:41.303327 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a31efb71-0b70-41cd-97f3-7603a5a14e60 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:41.311649 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a31efb71-0b70-41cd-97f3-7603a5a14e60 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:41.312208 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a31efb71-0b70-41cd-97f3-7603a5a14e60 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:41.313441 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a31efb71-0b70-41cd-97f3-7603a5a14e60 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:41.314031 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a31efb71-0b70-41cd-97f3-7603a5a14e60 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:41.502623 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a31efb71-0b70-41cd-97f3-7603a5a14e60 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:41.511322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a31efb71-0b70-41cd-97f3-7603a5a14e60 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.212494 Mar 30 07:22:41.512296 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 385/792] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:41 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:41.702637 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-044689d3-db42-4cd8-b041-b33c02054186 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:41.703280 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-044689d3-db42-4cd8-b041-b33c02054186 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:41.710177 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-044689d3-db42-4cd8-b041-b33c02054186 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:41.710725 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-044689d3-db42-4cd8-b041-b33c02054186 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:41.711709 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-044689d3-db42-4cd8-b041-b33c02054186 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:41.712174 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-044689d3-db42-4cd8-b041-b33c02054186 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:41.940553 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-044689d3-db42-4cd8-b041-b33c02054186 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:41.948228 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-044689d3-db42-4cd8-b041-b33c02054186 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.249379 Mar 30 07:22:41.948795 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 408/793] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:41 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:42.530110 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-87eb8e19-0029-42e6-a1b7-7e68393809c9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:42.531917 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-87eb8e19-0029-42e6-a1b7-7e68393809c9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:42.539690 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87eb8e19-0029-42e6-a1b7-7e68393809c9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:42.540939 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87eb8e19-0029-42e6-a1b7-7e68393809c9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:42.542809 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87eb8e19-0029-42e6-a1b7-7e68393809c9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:42.543673 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87eb8e19-0029-42e6-a1b7-7e68393809c9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:42.724105 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-87eb8e19-0029-42e6-a1b7-7e68393809c9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:42.735111 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-87eb8e19-0029-42e6-a1b7-7e68393809c9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.209371 Mar 30 07:22:42.736063 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 386/794] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:42 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:42.966229 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a721fb31-1380-437b-a8c7-d2c715e0ada6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:42.967653 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a721fb31-1380-437b-a8c7-d2c715e0ada6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:42.976440 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a721fb31-1380-437b-a8c7-d2c715e0ada6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:42.977873 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a721fb31-1380-437b-a8c7-d2c715e0ada6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:42.979003 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a721fb31-1380-437b-a8c7-d2c715e0ada6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:42.979652 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a721fb31-1380-437b-a8c7-d2c715e0ada6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:43.142401 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a721fb31-1380-437b-a8c7-d2c715e0ada6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:43.150485 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a721fb31-1380-437b-a8c7-d2c715e0ada6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.188622 Mar 30 07:22:43.151179 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 409/795] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:42 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:43.752950 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cf55018b-e454-4a50-aa72-66e83674bf39 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:43.753708 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cf55018b-e454-4a50-aa72-66e83674bf39 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:43.760369 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cf55018b-e454-4a50-aa72-66e83674bf39 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:43.761257 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cf55018b-e454-4a50-aa72-66e83674bf39 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:43.762181 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cf55018b-e454-4a50-aa72-66e83674bf39 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:43.762759 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-cf55018b-e454-4a50-aa72-66e83674bf39 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:43.916030 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cf55018b-e454-4a50-aa72-66e83674bf39 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:43.929085 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cf55018b-e454-4a50-aa72-66e83674bf39 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.180024 Mar 30 07:22:43.929671 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 387/796] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:43 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:22:44.169462 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a8d944c9-f9bb-49ba-8792-d2429393a898 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:44.170075 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a8d944c9-f9bb-49ba-8792-d2429393a898 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:44.182357 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a8d944c9-f9bb-49ba-8792-d2429393a898 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:44.183174 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a8d944c9-f9bb-49ba-8792-d2429393a898 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:44.184322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a8d944c9-f9bb-49ba-8792-d2429393a898 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:44.190201 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a8d944c9-f9bb-49ba-8792-d2429393a898 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:44.421451 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a8d944c9-f9bb-49ba-8792-d2429393a898 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:44.429476 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a8d944c9-f9bb-49ba-8792-d2429393a898 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.264478 Mar 30 07:22:44.430368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 410/797] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:44 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:44.946138 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1ffce065-f6f8-4265-b028-61f6885200d4 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:44.946944 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1ffce065-f6f8-4265-b028-61f6885200d4 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:44.958241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1ffce065-f6f8-4265-b028-61f6885200d4 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:44.959005 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1ffce065-f6f8-4265-b028-61f6885200d4 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:44.960433 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1ffce065-f6f8-4265-b028-61f6885200d4 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:44.961104 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1ffce065-f6f8-4265-b028-61f6885200d4 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:45.134908 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1ffce065-f6f8-4265-b028-61f6885200d4 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:45.142255 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1ffce065-f6f8-4265-b028-61f6885200d4 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.200881 Mar 30 07:22:45.142822 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 388/798] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:44 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:45.447660 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c9f88d50-2c37-4987-8635-c32324d0aadc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:45.448395 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c9f88d50-2c37-4987-8635-c32324d0aadc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:45.454973 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c9f88d50-2c37-4987-8635-c32324d0aadc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:45.455685 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c9f88d50-2c37-4987-8635-c32324d0aadc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:45.456498 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c9f88d50-2c37-4987-8635-c32324d0aadc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:45.457091 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c9f88d50-2c37-4987-8635-c32324d0aadc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:45.601255 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c9f88d50-2c37-4987-8635-c32324d0aadc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:45.609068 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c9f88d50-2c37-4987-8635-c32324d0aadc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.165817 Mar 30 07:22:45.609634 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 411/799] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:45 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:46.158761 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4d3ef401-eb31-4b14-8d58-6d8fc2ea7cfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:46.160021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4d3ef401-eb31-4b14-8d58-6d8fc2ea7cfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:46.166703 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4d3ef401-eb31-4b14-8d58-6d8fc2ea7cfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:46.167480 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4d3ef401-eb31-4b14-8d58-6d8fc2ea7cfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:46.168211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4d3ef401-eb31-4b14-8d58-6d8fc2ea7cfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:46.168644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4d3ef401-eb31-4b14-8d58-6d8fc2ea7cfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:46.304564 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-4d3ef401-eb31-4b14-8d58-6d8fc2ea7cfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:46.312202 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4d3ef401-eb31-4b14-8d58-6d8fc2ea7cfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.157240 Mar 30 07:22:46.312860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 389/800] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:46 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:46.627597 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d417fe93-d3f1-4998-9e26-d12db878132a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:46.628265 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d417fe93-d3f1-4998-9e26-d12db878132a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:46.639659 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d417fe93-d3f1-4998-9e26-d12db878132a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:46.640126 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d417fe93-d3f1-4998-9e26-d12db878132a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:46.640912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d417fe93-d3f1-4998-9e26-d12db878132a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:46.641339 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d417fe93-d3f1-4998-9e26-d12db878132a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:46.785494 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d417fe93-d3f1-4998-9e26-d12db878132a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:46.792990 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d417fe93-d3f1-4998-9e26-d12db878132a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.170368 Mar 30 07:22:46.793552 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 412/801] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:46 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:47.330054 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c85054d8-cfe4-45fd-933a-bc1974470ab9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:47.330702 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c85054d8-cfe4-45fd-933a-bc1974470ab9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:47.337341 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c85054d8-cfe4-45fd-933a-bc1974470ab9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:47.337780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c85054d8-cfe4-45fd-933a-bc1974470ab9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:47.338794 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c85054d8-cfe4-45fd-933a-bc1974470ab9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:47.339289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c85054d8-cfe4-45fd-933a-bc1974470ab9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:47.594744 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c85054d8-cfe4-45fd-933a-bc1974470ab9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:47.602874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c85054d8-cfe4-45fd-933a-bc1974470ab9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.276906 Mar 30 07:22:47.603423 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 390/802] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:47 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:47.810857 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-71917514-3092-4626-b049-d1aa8c8a6a08 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:47.812194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-71917514-3092-4626-b049-d1aa8c8a6a08 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:47.822140 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-71917514-3092-4626-b049-d1aa8c8a6a08 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:47.823033 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-71917514-3092-4626-b049-d1aa8c8a6a08 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:47.824193 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-71917514-3092-4626-b049-d1aa8c8a6a08 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:47.824904 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-71917514-3092-4626-b049-d1aa8c8a6a08 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:48.019613 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-40126755-04a4-4c8a-8a40-4d03755acd11 req-ce4bae8b-d934-4110-b98a-2418229d3b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee340ba-0fee-4661-a390-d524855526cb", "tag": "2248248f-9385-4ebf-85cd-c0c185df018b"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:48.030727 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-40126755-04a4-4c8a-8a40-4d03755acd11 req-ce4bae8b-d934-4110-b98a-2418229d3b28 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:48.033263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-40126755-04a4-4c8a-8a40-4d03755acd11 req-ce4bae8b-d934-4110-b98a-2418229d3b28 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:48.045017 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-40126755-04a4-4c8a-8a40-4d03755acd11 req-ce4bae8b-d934-4110-b98a-2418229d3b28 service nova] Creating event network-changed:2248248f-9385-4ebf-85cd-c0c185df018b for instance aee340ba-0fee-4661-a390-d524855526cb on hv-cinder-83577 Mar 30 07:22:48.050397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-40126755-04a4-4c8a-8a40-4d03755acd11 req-ce4bae8b-d934-4110-b98a-2418229d3b28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034416 Mar 30 07:22:48.051190 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 391/803] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:22:48.067258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-71917514-3092-4626-b049-d1aa8c8a6a08 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:48.076646 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-71917514-3092-4626-b049-d1aa8c8a6a08 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.270090 Mar 30 07:22:48.077661 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 413/804] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:47 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:22:48.622591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-44a4b661-367e-423e-9449-d97e4686919e tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:48.623447 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-44a4b661-367e-423e-9449-d97e4686919e tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:48.629802 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-44a4b661-367e-423e-9449-d97e4686919e tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:48.630377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-44a4b661-367e-423e-9449-d97e4686919e tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:48.631259 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-44a4b661-367e-423e-9449-d97e4686919e tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:48.631796 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-44a4b661-367e-423e-9449-d97e4686919e tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:48.896456 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-44a4b661-367e-423e-9449-d97e4686919e tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:48.904687 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-44a4b661-367e-423e-9449-d97e4686919e tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.287832 Mar 30 07:22:48.905311 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 392/805] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:48 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:49.094387 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5672a6a5-28d1-445b-b153-c9247eecc877 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:49.095683 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5672a6a5-28d1-445b-b153-c9247eecc877 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:49.102998 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5672a6a5-28d1-445b-b153-c9247eecc877 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:49.103446 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5672a6a5-28d1-445b-b153-c9247eecc877 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:49.104464 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5672a6a5-28d1-445b-b153-c9247eecc877 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:49.105069 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5672a6a5-28d1-445b-b153-c9247eecc877 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:49.257909 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5672a6a5-28d1-445b-b153-c9247eecc877 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:49.265432 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5672a6a5-28d1-445b-b153-c9247eecc877 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.175168 Mar 30 07:22:49.266010 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 414/806] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:49 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:49.921331 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bcbdc7b6-ff81-4071-a472-aa52a0ba3dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:49.922193 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-bcbdc7b6-ff81-4071-a472-aa52a0ba3dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:49.928699 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bcbdc7b6-ff81-4071-a472-aa52a0ba3dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:49.929138 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bcbdc7b6-ff81-4071-a472-aa52a0ba3dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:49.930198 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bcbdc7b6-ff81-4071-a472-aa52a0ba3dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:49.930570 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bcbdc7b6-ff81-4071-a472-aa52a0ba3dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:50.082286 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-bcbdc7b6-ff81-4071-a472-aa52a0ba3dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:50.090239 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-bcbdc7b6-ff81-4071-a472-aa52a0ba3dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.172752 Mar 30 07:22:50.090832 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 393/807] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:49 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:50.286948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-27272ed2-d39e-4aeb-a6a0-85ea01634814 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:50.289272 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-27272ed2-d39e-4aeb-a6a0-85ea01634814 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:50.301242 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27272ed2-d39e-4aeb-a6a0-85ea01634814 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:50.302097 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27272ed2-d39e-4aeb-a6a0-85ea01634814 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:50.303184 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27272ed2-d39e-4aeb-a6a0-85ea01634814 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:50.303738 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27272ed2-d39e-4aeb-a6a0-85ea01634814 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:50.452979 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-27272ed2-d39e-4aeb-a6a0-85ea01634814 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:50.463594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-27272ed2-d39e-4aeb-a6a0-85ea01634814 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.183317 Mar 30 07:22:50.464570 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 415/808] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:50 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:51.114708 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-09660fb8-122e-49de-a010-2d3042df7508 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:51.115680 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-09660fb8-122e-49de-a010-2d3042df7508 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:51.127142 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-09660fb8-122e-49de-a010-2d3042df7508 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:51.128123 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-09660fb8-122e-49de-a010-2d3042df7508 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:51.129335 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-09660fb8-122e-49de-a010-2d3042df7508 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:51.130057 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-09660fb8-122e-49de-a010-2d3042df7508 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:51.281189 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-09660fb8-122e-49de-a010-2d3042df7508 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:51.288605 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-09660fb8-122e-49de-a010-2d3042df7508 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.180482 Mar 30 07:22:51.289145 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 394/809] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:51 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:51.481361 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9897359c-a880-4d54-a3e6-013a6b01b919 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:51.482007 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9897359c-a880-4d54-a3e6-013a6b01b919 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:51.488829 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9897359c-a880-4d54-a3e6-013a6b01b919 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:51.489283 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9897359c-a880-4d54-a3e6-013a6b01b919 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:51.490124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9897359c-a880-4d54-a3e6-013a6b01b919 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:51.490565 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9897359c-a880-4d54-a3e6-013a6b01b919 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:51.632112 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9897359c-a880-4d54-a3e6-013a6b01b919 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:51.639488 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9897359c-a880-4d54-a3e6-013a6b01b919 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.162896 Mar 30 07:22:51.640085 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 416/810] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:51 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:52.307476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-62cfb430-bd4e-4bbf-a779-89f14cff5ce7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:52.308108 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-62cfb430-bd4e-4bbf-a779-89f14cff5ce7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:52.314856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-62cfb430-bd4e-4bbf-a779-89f14cff5ce7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:52.315306 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-62cfb430-bd4e-4bbf-a779-89f14cff5ce7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:52.316096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-62cfb430-bd4e-4bbf-a779-89f14cff5ce7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:52.316534 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-62cfb430-bd4e-4bbf-a779-89f14cff5ce7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:52.456601 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-62cfb430-bd4e-4bbf-a779-89f14cff5ce7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:52.464385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-62cfb430-bd4e-4bbf-a779-89f14cff5ce7 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.162735 Mar 30 07:22:52.464954 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 395/811] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:52 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:52.661530 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-68bf74ea-e585-41f4-b0be-7d2ca54e450a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:52.662493 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-68bf74ea-e585-41f4-b0be-7d2ca54e450a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:52.671984 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68bf74ea-e585-41f4-b0be-7d2ca54e450a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:52.672438 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68bf74ea-e585-41f4-b0be-7d2ca54e450a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:52.673204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68bf74ea-e585-41f4-b0be-7d2ca54e450a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:52.673635 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-68bf74ea-e585-41f4-b0be-7d2ca54e450a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:52.818091 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-68bf74ea-e585-41f4-b0be-7d2ca54e450a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:52.826142 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-68bf74ea-e585-41f4-b0be-7d2ca54e450a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.171756 Mar 30 07:22:52.826735 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 417/812] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:52 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:53.482841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-121d147b-7cb1-43da-ac23-3f413efd11c3 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:53.483487 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-121d147b-7cb1-43da-ac23-3f413efd11c3 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:53.490234 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-121d147b-7cb1-43da-ac23-3f413efd11c3 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:53.490687 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-121d147b-7cb1-43da-ac23-3f413efd11c3 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:53.491506 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-121d147b-7cb1-43da-ac23-3f413efd11c3 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:53.492236 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-121d147b-7cb1-43da-ac23-3f413efd11c3 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:53.662890 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-121d147b-7cb1-43da-ac23-3f413efd11c3 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:53.671063 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-121d147b-7cb1-43da-ac23-3f413efd11c3 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.192586 Mar 30 07:22:53.671645 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 396/813] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:53 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:53.843364 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e2c7f14f-b8fa-42fe-a8af-d1e238666042 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:53.844539 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e2c7f14f-b8fa-42fe-a8af-d1e238666042 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:53.850970 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e2c7f14f-b8fa-42fe-a8af-d1e238666042 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:53.851417 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e2c7f14f-b8fa-42fe-a8af-d1e238666042 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:53.852620 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e2c7f14f-b8fa-42fe-a8af-d1e238666042 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:53.853177 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e2c7f14f-b8fa-42fe-a8af-d1e238666042 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:53.997966 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e2c7f14f-b8fa-42fe-a8af-d1e238666042 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:54.005620 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e2c7f14f-b8fa-42fe-a8af-d1e238666042 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.166389 Mar 30 07:22:54.006221 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 418/814] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:53 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:54.688527 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e03f6ffa-c074-4f7d-a621-1990dfc79684 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:54.689105 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e03f6ffa-c074-4f7d-a621-1990dfc79684 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:54.695604 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e03f6ffa-c074-4f7d-a621-1990dfc79684 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:54.696087 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e03f6ffa-c074-4f7d-a621-1990dfc79684 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:54.696850 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e03f6ffa-c074-4f7d-a621-1990dfc79684 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:54.697274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e03f6ffa-c074-4f7d-a621-1990dfc79684 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:54.839340 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e03f6ffa-c074-4f7d-a621-1990dfc79684 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:54.847267 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e03f6ffa-c074-4f7d-a621-1990dfc79684 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.162680 Mar 30 07:22:54.848414 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 397/815] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:54 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:55.022784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-39abb9ea-1c64-4d97-9373-b00e753de024 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:55.023403 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-39abb9ea-1c64-4d97-9373-b00e753de024 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:55.029865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-39abb9ea-1c64-4d97-9373-b00e753de024 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:55.030725 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-39abb9ea-1c64-4d97-9373-b00e753de024 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:55.031346 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-39abb9ea-1c64-4d97-9373-b00e753de024 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:55.031795 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-39abb9ea-1c64-4d97-9373-b00e753de024 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:55.175046 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-39abb9ea-1c64-4d97-9373-b00e753de024 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:55.178591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-ec0168ba-d979-4e2e-9554-b7add5684d5c req-dec41ed8-866f-4b44-87e8-cecd25bcdeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee340ba-0fee-4661-a390-d524855526cb", "name": "network-vif-plugged", "status": "completed", "tag": "2248248f-9385-4ebf-85cd-c0c185df018b"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:55.183560 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-39abb9ea-1c64-4d97-9373-b00e753de024 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.164581 Mar 30 07:22:55.185819 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 419/816] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:55 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:55.187427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-ec0168ba-d979-4e2e-9554-b7add5684d5c req-dec41ed8-866f-4b44-87e8-cecd25bcdeb2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:55.187780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-ec0168ba-d979-4e2e-9554-b7add5684d5c req-dec41ed8-866f-4b44-87e8-cecd25bcdeb2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:55.199353 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-ec0168ba-d979-4e2e-9554-b7add5684d5c req-dec41ed8-866f-4b44-87e8-cecd25bcdeb2 service nova] Creating event network-vif-plugged:2248248f-9385-4ebf-85cd-c0c185df018b for instance aee340ba-0fee-4661-a390-d524855526cb on hv-cinder-83577 Mar 30 07:22:55.205059 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-ec0168ba-d979-4e2e-9554-b7add5684d5c req-dec41ed8-866f-4b44-87e8-cecd25bcdeb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030824 Mar 30 07:22:55.206030 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 398/817] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:22:55.867503 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-41ecc607-afef-4ea4-b4f0-c0fea4e85d42 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:55.868166 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-41ecc607-afef-4ea4-b4f0-c0fea4e85d42 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:55.874966 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-41ecc607-afef-4ea4-b4f0-c0fea4e85d42 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:55.875478 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-41ecc607-afef-4ea4-b4f0-c0fea4e85d42 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:55.876366 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-41ecc607-afef-4ea4-b4f0-c0fea4e85d42 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:55.876827 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-41ecc607-afef-4ea4-b4f0-c0fea4e85d42 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:56.024788 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-41ecc607-afef-4ea4-b4f0-c0fea4e85d42 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:56.033605 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-41ecc607-afef-4ea4-b4f0-c0fea4e85d42 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1359 microversion: 2.1 time: 0.169990 Mar 30 07:22:56.035078 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 420/818] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:55 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:56.206686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-30ebf5f9-a578-4a03-b8a5-b12bed362e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:56.207448 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-30ebf5f9-a578-4a03-b8a5-b12bed362e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:56.214880 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30ebf5f9-a578-4a03-b8a5-b12bed362e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:56.215446 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30ebf5f9-a578-4a03-b8a5-b12bed362e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:56.216252 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30ebf5f9-a578-4a03-b8a5-b12bed362e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:56.216678 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30ebf5f9-a578-4a03-b8a5-b12bed362e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:56.356164 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-30ebf5f9-a578-4a03-b8a5-b12bed362e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:56.363774 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-30ebf5f9-a578-4a03-b8a5-b12bed362e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.164749 Mar 30 07:22:56.364370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 399/819] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:56 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:57.053482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-16847883-dd41-4bb6-afcc-3723d993edfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:57.054095 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-16847883-dd41-4bb6-afcc-3723d993edfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:57.061104 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-16847883-dd41-4bb6-afcc-3723d993edfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.061895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-16847883-dd41-4bb6-afcc-3723d993edfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.062854 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-16847883-dd41-4bb6-afcc-3723d993edfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.063749 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-16847883-dd41-4bb6-afcc-3723d993edfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.215302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-16847883-dd41-4bb6-afcc-3723d993edfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:57.225399 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-16847883-dd41-4bb6-afcc-3723d993edfd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1548 microversion: 2.1 time: 0.175768 Mar 30 07:22:57.226071 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 421/820] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:57 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:57.235595 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-7090f4f7-d8d6-4244-95b7-3a613d67e1ff req-6a80a741-52ce-45d3-9be8-166877e7ddb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153dd568-5bf9-4ddc-9221-8fe74c4bd58b", "name": "network-vif-plugged", "status": "completed", "tag": "ec40b8bb-3831-42fc-bb08-d0b7a674e052"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:57.244997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b3c8e9a1-7a94-42ac-a714-06d2ca6cb3f2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:57.245611 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b3c8e9a1-7a94-42ac-a714-06d2ca6cb3f2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:57.246478 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7090f4f7-d8d6-4244-95b7-3a613d67e1ff req-6a80a741-52ce-45d3-9be8-166877e7ddb4 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.247143 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7090f4f7-d8d6-4244-95b7-3a613d67e1ff req-6a80a741-52ce-45d3-9be8-166877e7ddb4 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.252038 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3c8e9a1-7a94-42ac-a714-06d2ca6cb3f2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.252494 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3c8e9a1-7a94-42ac-a714-06d2ca6cb3f2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.253283 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3c8e9a1-7a94-42ac-a714-06d2ca6cb3f2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.253721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b3c8e9a1-7a94-42ac-a714-06d2ca6cb3f2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.259211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-7090f4f7-d8d6-4244-95b7-3a613d67e1ff req-6a80a741-52ce-45d3-9be8-166877e7ddb4 service nova] Creating event network-vif-plugged:ec40b8bb-3831-42fc-bb08-d0b7a674e052 for instance 153dd568-5bf9-4ddc-9221-8fe74c4bd58b on hv-cinder-83577 Mar 30 07:22:57.264667 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-7090f4f7-d8d6-4244-95b7-3a613d67e1ff req-6a80a741-52ce-45d3-9be8-166877e7ddb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033406 Mar 30 07:22:57.265262 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 400/821] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:57.381594 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-02128eee-5cd6-4ed6-8ea7-d6e1fdbeeb11 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:57.382742 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-02128eee-5cd6-4ed6-8ea7-d6e1fdbeeb11 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:57.389706 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-02128eee-5cd6-4ed6-8ea7-d6e1fdbeeb11 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.390149 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-02128eee-5cd6-4ed6-8ea7-d6e1fdbeeb11 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.390960 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-02128eee-5cd6-4ed6-8ea7-d6e1fdbeeb11 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.391395 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-02128eee-5cd6-4ed6-8ea7-d6e1fdbeeb11 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.410891 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b3c8e9a1-7a94-42ac-a714-06d2ca6cb3f2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:57.418942 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b3c8e9a1-7a94-42ac-a714-06d2ca6cb3f2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1548 microversion: 2.1 time: 0.177738 Mar 30 07:22:57.420045 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 422/822] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:57 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:57.435065 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:57.439359 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:57.440227 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Searching by: {'deleted': False, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45'} {{(pid=117062) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 30 07:22:57.447203 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.448023 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.448821 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.449228 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.547185 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.multi_cell_list [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117062) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 30 07:22:57.571154 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-02128eee-5cd6-4ed6-8ea7-d6e1fdbeeb11 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:57.581753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-02128eee-5cd6-4ed6-8ea7-d6e1fdbeeb11 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.204391 Mar 30 07:22:57.582352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 401/823] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:57 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:22:57.645875 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0133831c-2030-46b3-b5c4-93129d920dfc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214415 Mar 30 07:22:57.646501 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 423/824] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Mar 30 07:22:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:57.657947 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8bdf3521-68c7-42df-8263-598117b25c30 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:57.658561 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-8bdf3521-68c7-42df-8263-598117b25c30 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:57.664882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8bdf3521-68c7-42df-8263-598117b25c30 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.665249 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8bdf3521-68c7-42df-8263-598117b25c30 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.666006 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8bdf3521-68c7-42df-8263-598117b25c30 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:57.666435 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8bdf3521-68c7-42df-8263-598117b25c30 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:57.804061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-8bdf3521-68c7-42df-8263-598117b25c30 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:57.812873 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-8bdf3521-68c7-42df-8263-598117b25c30 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1548 microversion: 2.1 time: 0.159638 Mar 30 07:22:57.813570 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 402/825] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:57 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:58.598936 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-718476df-ba2b-419a-8065-f4484d55b5a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:58.600230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-718476df-ba2b-419a-8065-f4484d55b5a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:58.607142 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-718476df-ba2b-419a-8065-f4484d55b5a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:58.607604 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-718476df-ba2b-419a-8065-f4484d55b5a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:58.608562 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-718476df-ba2b-419a-8065-f4484d55b5a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:58.609070 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-718476df-ba2b-419a-8065-f4484d55b5a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:58.764693 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-718476df-ba2b-419a-8065-f4484d55b5a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:58.772667 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-718476df-ba2b-419a-8065-f4484d55b5a9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1266 microversion: 2.1 time: 0.177700 Mar 30 07:22:58.773616 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 424/826] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:58 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:59.357373 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-926cd04e-69ee-4acb-a010-3bf4a9a561a8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c022858-6d96-4985-8bf2-7332720e69da"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:22:59.358777 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-926cd04e-69ee-4acb-a010-3bf4a9a561a8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:59.366226 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-926cd04e-69ee-4acb-a010-3bf4a9a561a8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:59.366709 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-926cd04e-69ee-4acb-a010-3bf4a9a561a8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:59.367528 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-926cd04e-69ee-4acb-a010-3bf4a9a561a8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:59.368043 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-926cd04e-69ee-4acb-a010-3bf4a9a561a8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:59.662795 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-926cd04e-69ee-4acb-a010-3bf4a9a561a8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "POST /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309534 Mar 30 07:22:59.663415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 403/827] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:22:59 2022] POST /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:22:59.791548 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e2a914e5-17a1-4a01-876a-6dacaff86fe6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:59.792196 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e2a914e5-17a1-4a01-876a-6dacaff86fe6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:59.799021 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e2a914e5-17a1-4a01-876a-6dacaff86fe6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:59.799468 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e2a914e5-17a1-4a01-876a-6dacaff86fe6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:59.800330 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e2a914e5-17a1-4a01-876a-6dacaff86fe6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:59.800784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e2a914e5-17a1-4a01-876a-6dacaff86fe6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:59.942295 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-e2a914e5-17a1-4a01-876a-6dacaff86fe6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:22:59.951314 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e2a914e5-17a1-4a01-876a-6dacaff86fe6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1452 microversion: 2.1 time: 0.163569 Mar 30 07:22:59.951957 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 425/828] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:59 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:22:59.969233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f2ebcc73-f6c0-4ab7-bd1b-bf4f3faaf88e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:22:59.970018 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f2ebcc73-f6c0-4ab7-bd1b-bf4f3faaf88e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:22:59.976638 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f2ebcc73-f6c0-4ab7-bd1b-bf4f3faaf88e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:59.977451 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f2ebcc73-f6c0-4ab7-bd1b-bf4f3faaf88e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:22:59.978211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f2ebcc73-f6c0-4ab7-bd1b-bf4f3faaf88e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:22:59.978761 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f2ebcc73-f6c0-4ab7-bd1b-bf4f3faaf88e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:00.133225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f2ebcc73-f6c0-4ab7-bd1b-bf4f3faaf88e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:00.141670 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f2ebcc73-f6c0-4ab7-bd1b-bf4f3faaf88e tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1452 microversion: 2.1 time: 0.177547 Mar 30 07:23:00.142173 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 404/829] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:22:59 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:02.132623 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-70bed44c-473a-444c-8cdb-1f0110b1c5d1 req-1ade3664-b78a-4407-b0ef-385e8e1fc6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153dd568-5bf9-4ddc-9221-8fe74c4bd58b", "tag": "ec40b8bb-3831-42fc-bb08-d0b7a674e052"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:02.141744 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-70bed44c-473a-444c-8cdb-1f0110b1c5d1 req-1ade3664-b78a-4407-b0ef-385e8e1fc6ac service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:02.142202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-70bed44c-473a-444c-8cdb-1f0110b1c5d1 req-1ade3664-b78a-4407-b0ef-385e8e1fc6ac service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:02.156739 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-70bed44c-473a-444c-8cdb-1f0110b1c5d1 req-1ade3664-b78a-4407-b0ef-385e8e1fc6ac service nova] Creating event network-changed:ec40b8bb-3831-42fc-bb08-d0b7a674e052 for instance 153dd568-5bf9-4ddc-9221-8fe74c4bd58b on hv-cinder-83577 Mar 30 07:23:02.161917 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-70bed44c-473a-444c-8cdb-1f0110b1c5d1 req-1ade3664-b78a-4407-b0ef-385e8e1fc6ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032904 Mar 30 07:23:02.162519 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 426/830] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:07.224676 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e1320e3b-a4d5-423c-b4e5-1592c2dc1eda tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:07.225279 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e1320e3b-a4d5-423c-b4e5-1592c2dc1eda tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:07.232291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e1320e3b-a4d5-423c-b4e5-1592c2dc1eda tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:07.232737 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e1320e3b-a4d5-423c-b4e5-1592c2dc1eda tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:07.233535 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e1320e3b-a4d5-423c-b4e5-1592c2dc1eda tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:07.233921 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e1320e3b-a4d5-423c-b4e5-1592c2dc1eda tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:07.370242 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e1320e3b-a4d5-423c-b4e5-1592c2dc1eda tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:07.382003 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e1320e3b-a4d5-423c-b4e5-1592c2dc1eda tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1594 microversion: 2.1 time: 0.161444 Mar 30 07:23:07.382577 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 405/831] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:07 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:09.474733 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-a4ab2777-33ca-43f0-8b01-d25324894902 req-f439f0e8-7e7f-4ac5-8482-999f10f50e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee340ba-0fee-4661-a390-d524855526cb", "tag": "2248248f-9385-4ebf-85cd-c0c185df018b"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:09.483261 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a4ab2777-33ca-43f0-8b01-d25324894902 req-f439f0e8-7e7f-4ac5-8482-999f10f50e0e service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:09.483690 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a4ab2777-33ca-43f0-8b01-d25324894902 req-f439f0e8-7e7f-4ac5-8482-999f10f50e0e service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:09.496086 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-a4ab2777-33ca-43f0-8b01-d25324894902 req-f439f0e8-7e7f-4ac5-8482-999f10f50e0e service nova] Creating event network-changed:2248248f-9385-4ebf-85cd-c0c185df018b for instance aee340ba-0fee-4661-a390-d524855526cb on hv-cinder-83577 Mar 30 07:23:09.501972 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-a4ab2777-33ca-43f0-8b01-d25324894902 req-f439f0e8-7e7f-4ac5-8482-999f10f50e0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031847 Mar 30 07:23:09.502660 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 427/832] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:10.637349 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a2cd191c-6674-4f25-a904-0d9a742e6f40 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-992873962"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:10.638001 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a2cd191c-6674-4f25-a904-0d9a742e6f40 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:10.644291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a2cd191c-6674-4f25-a904-0d9a742e6f40 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:10.644739 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a2cd191c-6674-4f25-a904-0d9a742e6f40 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:10.645763 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a2cd191c-6674-4f25-a904-0d9a742e6f40 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:10.646197 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a2cd191c-6674-4f25-a904-0d9a742e6f40 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:10.785023 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.network.security_group_api [None req-a2cd191c-6674-4f25-a904-0d9a742e6f40 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Adding security group bb1a96a7-a798-4b5e-9bc2-b6bedc0df24e to port 2248248f-9385-4ebf-85cd-c0c185df018b Mar 30 07:23:11.147427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a2cd191c-6674-4f25-a904-0d9a742e6f40 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "POST /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/action" status: 202 len: 0 microversion: 2.1 time: 0.513980 Mar 30 07:23:11.148079 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 406/833] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:23:10 2022] POST /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:23:11.157960 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-40a3e8c2-a7b8-4688-b2a0-85b9f43a08bd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:11.158665 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-40a3e8c2-a7b8-4688-b2a0-85b9f43a08bd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:11.165174 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-40a3e8c2-a7b8-4688-b2a0-85b9f43a08bd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:11.165619 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-40a3e8c2-a7b8-4688-b2a0-85b9f43a08bd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:11.166397 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-40a3e8c2-a7b8-4688-b2a0-85b9f43a08bd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:11.166823 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-40a3e8c2-a7b8-4688-b2a0-85b9f43a08bd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:11.339373 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-40a3e8c2-a7b8-4688-b2a0-85b9f43a08bd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:11.348397 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-40a3e8c2-a7b8-4688-b2a0-85b9f43a08bd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1759 microversion: 2.1 time: 0.195213 Mar 30 07:23:11.349057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 428/834] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:11 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:11.516894 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-79daf6db-dba7-4896-bbe8-f31f7380e964 req-d4866596-c507-41c3-98d9-aa05cf5721c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee340ba-0fee-4661-a390-d524855526cb", "tag": "2248248f-9385-4ebf-85cd-c0c185df018b"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:11.525360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-79daf6db-dba7-4896-bbe8-f31f7380e964 req-d4866596-c507-41c3-98d9-aa05cf5721c7 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:11.525810 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-79daf6db-dba7-4896-bbe8-f31f7380e964 req-d4866596-c507-41c3-98d9-aa05cf5721c7 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:11.536941 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-79daf6db-dba7-4896-bbe8-f31f7380e964 req-d4866596-c507-41c3-98d9-aa05cf5721c7 service nova] Creating event network-changed:2248248f-9385-4ebf-85cd-c0c185df018b for instance aee340ba-0fee-4661-a390-d524855526cb on hv-cinder-83577 Mar 30 07:23:11.541943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-79daf6db-dba7-4896-bbe8-f31f7380e964 req-d4866596-c507-41c3-98d9-aa05cf5721c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028803 Mar 30 07:23:11.542537 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 407/835] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:14.814387 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2c15e241-4610-4ccf-b92e-9338912b1d3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:14.815318 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2c15e241-4610-4ccf-b92e-9338912b1d3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:14.823111 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2c15e241-4610-4ccf-b92e-9338912b1d3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:14.823559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2c15e241-4610-4ccf-b92e-9338912b1d3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:14.824350 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2c15e241-4610-4ccf-b92e-9338912b1d3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:14.824781 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2c15e241-4610-4ccf-b92e-9338912b1d3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:14.847262 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2c15e241-4610-4ccf-b92e-9338912b1d3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/ips" status: 200 len: 151 microversion: 2.1 time: 0.039371 Mar 30 07:23:14.847839 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 429/836] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:23:14 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:16.230556 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b11f9549-c4df-4931-a87b-71f2cb3cda84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76aafcd8-da6d-4b7a-9bd9-7c54a75ef28d"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:16.231704 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b11f9549-c4df-4931-a87b-71f2cb3cda84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:16.238112 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b11f9549-c4df-4931-a87b-71f2cb3cda84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:16.238554 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b11f9549-c4df-4931-a87b-71f2cb3cda84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:16.239311 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b11f9549-c4df-4931-a87b-71f2cb3cda84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:16.239739 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b11f9549-c4df-4931-a87b-71f2cb3cda84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:16.505065 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b11f9549-c4df-4931-a87b-71f2cb3cda84 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279950 Mar 30 07:23:16.505681 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 408/837] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:23:16 2022] POST /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:24.048144 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-709b83fe-7ce2-45c3-8330-cacc59d608bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: .version_select at 0x7f154c5ebaf0>, body: {"keypair": {"name": "tempest-keypair-1916623287"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:24.069559 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-709b83fe-7ce2-45c3-8330-cacc59d608bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:23:24.075385 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-709b83fe-7ce2-45c3-8330-cacc59d608bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:23:24.327576 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-709b83fe-7ce2-45c3-8330-cacc59d608bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:23:24.331384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-709b83fe-7ce2-45c3-8330-cacc59d608bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:23:24.346544 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-709b83fe-7ce2-45c3-8330-cacc59d608bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.305947 Mar 30 07:23:24.347435 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 430/838] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:23:24 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:25.684874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-673531922", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73dd56e2-c247-440c-aa55-c3633a082de7"}], "security_groups": [{"name": "tempest-securitygroup--1515749798"}], "key_name": "tempest-keypair-1916623287", "user_data": "}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:25.795651 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] validate_networks() for [('73dd56e2-c247-440c-aa55-c3633a082de7', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:23:26.181667 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:23:26.182093 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:23:26.182569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:23:26.182979 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:23:26.183484 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:23:26.192557 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:26.193008 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:26.193818 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:26.194254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:26.211494 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:23:26.216255 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:23:26.227725 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:23:26.230533 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:23:26.277290 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a0a6e53f-d5ce-4dc3-924c-5f091157ca2e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597625 Mar 30 07:23:26.277919 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 409/839] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:23:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:23:26.287912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0a8456fc-83e5-4b55-8cb7-b73c7a442218 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:26.288612 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0a8456fc-83e5-4b55-8cb7-b73c7a442218 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:26.343210 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0a8456fc-83e5-4b55-8cb7-b73c7a442218 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:26.350315 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0a8456fc-83e5-4b55-8cb7-b73c7a442218 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1241 microversion: 2.1 time: 0.065998 Mar 30 07:23:26.351126 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 431/840] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:26 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:27.369868 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6de741b9-9c0a-4f56-aba8-7a2206b2baef tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:27.371219 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6de741b9-9c0a-4f56-aba8-7a2206b2baef tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:27.379241 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6de741b9-9c0a-4f56-aba8-7a2206b2baef tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:27.380188 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6de741b9-9c0a-4f56-aba8-7a2206b2baef tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:27.381232 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6de741b9-9c0a-4f56-aba8-7a2206b2baef tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:27.381728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6de741b9-9c0a-4f56-aba8-7a2206b2baef tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:27.457944 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6de741b9-9c0a-4f56-aba8-7a2206b2baef tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:27.467160 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6de741b9-9c0a-4f56-aba8-7a2206b2baef tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1311 microversion: 2.1 time: 0.102407 Mar 30 07:23:27.467975 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 410/841] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:27 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:28.487436 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c3808bbe-2c77-4fa4-a3d0-0b69bc8c6dfd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:28.488819 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c3808bbe-2c77-4fa4-a3d0-0b69bc8c6dfd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:28.497662 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c3808bbe-2c77-4fa4-a3d0-0b69bc8c6dfd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:28.498723 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c3808bbe-2c77-4fa4-a3d0-0b69bc8c6dfd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:28.500301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c3808bbe-2c77-4fa4-a3d0-0b69bc8c6dfd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:28.500806 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c3808bbe-2c77-4fa4-a3d0-0b69bc8c6dfd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:28.748295 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c3808bbe-2c77-4fa4-a3d0-0b69bc8c6dfd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:28.756062 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c3808bbe-2c77-4fa4-a3d0-0b69bc8c6dfd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1367 microversion: 2.1 time: 0.273128 Mar 30 07:23:28.756840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 432/842] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:28 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:28.884281 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-a7b5657a-b674-451f-8c2e-6dd1fc721f34 req-fea468ee-e843-4f54-943b-c9cc61b24093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e27669-29a8-48a3-b442-ee2cc19176c3", "tag": "2677b771-ec44-40a5-bd54-2aac9661dc44"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:28.899488 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-a7b5657a-b674-451f-8c2e-6dd1fc721f34 req-fea468ee-e843-4f54-943b-c9cc61b24093 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:28.899990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-a7b5657a-b674-451f-8c2e-6dd1fc721f34 req-fea468ee-e843-4f54-943b-c9cc61b24093 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:28.920318 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-a7b5657a-b674-451f-8c2e-6dd1fc721f34 req-fea468ee-e843-4f54-943b-c9cc61b24093 service nova] Creating event network-changed:2677b771-ec44-40a5-bd54-2aac9661dc44 for instance c4e27669-29a8-48a3-b442-ee2cc19176c3 on hv-cinder-83577 Mar 30 07:23:28.925274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-a7b5657a-b674-451f-8c2e-6dd1fc721f34 req-fea468ee-e843-4f54-943b-c9cc61b24093 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047829 Mar 30 07:23:28.926096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 411/843] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:29.658299 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2134790015", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:29.709287 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] validate_networks() for None {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:23:29.774186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d385ed4f-728c-4116-a4b3-03e6252b535d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:29.774963 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d385ed4f-728c-4116-a4b3-03e6252b535d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:29.781669 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d385ed4f-728c-4116-a4b3-03e6252b535d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:29.782246 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d385ed4f-728c-4116-a4b3-03e6252b535d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:29.783047 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d385ed4f-728c-4116-a4b3-03e6252b535d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:29.783510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d385ed4f-728c-4116-a4b3-03e6252b535d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:30.421923 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:23:30.422406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:23:30.422938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:23:30.423406 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:23:30.423837 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:23:30.434141 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:30.434581 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:30.435417 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:30.435910 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:30.452852 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Getting quotas for project d7c15e6913c445c3be0d970eedf206ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:23:30.456884 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Getting quotas for user 315896d65bea44dda7c1a74a9d0612ff and project d7c15e6913c445c3be0d970eedf206ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:23:30.464506 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-d385ed4f-728c-4116-a4b3-03e6252b535d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:30.470326 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:23:30.472798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d385ed4f-728c-4116-a4b3-03e6252b535d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1367 microversion: 2.1 time: 0.702810 Mar 30 07:23:30.472948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:23:30.473507 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 412/844] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:29 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1367 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:30.519784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-589a7221-52ce-41ed-b9a2-666f57ee9a06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865383 Mar 30 07:23:30.520656 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 433/845] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:23:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:23:30.531233 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-cc4c7134-0a7f-47e4-acb6-2b504969d446 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:30.531871 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-cc4c7134-0a7f-47e4-acb6-2b504969d446 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:30.582874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-cc4c7134-0a7f-47e4-acb6-2b504969d446 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:30.590042 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-cc4c7134-0a7f-47e4-acb6-2b504969d446 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1215 microversion: 2.1 time: 0.063434 Mar 30 07:23:30.590618 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 413/846] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:30 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:31.491950 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-029e55c0-3a8d-48a0-a8ef-07c62fc35284 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:31.493397 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-029e55c0-3a8d-48a0-a8ef-07c62fc35284 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:31.500980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-029e55c0-3a8d-48a0-a8ef-07c62fc35284 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:31.501722 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-029e55c0-3a8d-48a0-a8ef-07c62fc35284 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:31.502750 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-029e55c0-3a8d-48a0-a8ef-07c62fc35284 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:31.503378 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-029e55c0-3a8d-48a0-a8ef-07c62fc35284 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:31.607493 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-34bf21b6-c75c-4630-aa53-bd77f9a28b2c tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:31.608850 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-34bf21b6-c75c-4630-aa53-bd77f9a28b2c tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:31.615954 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-34bf21b6-c75c-4630-aa53-bd77f9a28b2c tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:31.616711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-34bf21b6-c75c-4630-aa53-bd77f9a28b2c tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:31.617738 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-34bf21b6-c75c-4630-aa53-bd77f9a28b2c tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:31.618364 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-34bf21b6-c75c-4630-aa53-bd77f9a28b2c tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:31.727631 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-34bf21b6-c75c-4630-aa53-bd77f9a28b2c tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:31.735380 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-34bf21b6-c75c-4630-aa53-bd77f9a28b2c tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1285 microversion: 2.1 time: 0.131984 Mar 30 07:23:31.735958 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 414/847] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:31 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:23:31.859194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-029e55c0-3a8d-48a0-a8ef-07c62fc35284 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:31.866467 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-029e55c0-3a8d-48a0-a8ef-07c62fc35284 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1367 microversion: 2.1 time: 0.379661 Mar 30 07:23:31.867050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 434/848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:31 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:32.594318 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4ee66bd1-ab52-4655-964a-11e2b828c306 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:32.595021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4ee66bd1-ab52-4655-964a-11e2b828c306 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:32.597717 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-33a03378-e1f5-4b8c-8a9c-15f695637778 req-7b0cfd90-3325-4083-b65c-619754c9f57e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1770fd40-dd13-44c5-a045-2552bc5420dd", "tag": "2b0baaac-04a3-4147-9d07-17d4bc9c6c36"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:32.602147 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4ee66bd1-ab52-4655-964a-11e2b828c306 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:32.602818 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4ee66bd1-ab52-4655-964a-11e2b828c306 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:32.603757 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4ee66bd1-ab52-4655-964a-11e2b828c306 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:32.604515 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4ee66bd1-ab52-4655-964a-11e2b828c306 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:32.607742 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-33a03378-e1f5-4b8c-8a9c-15f695637778 req-7b0cfd90-3325-4083-b65c-619754c9f57e service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:32.608573 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-33a03378-e1f5-4b8c-8a9c-15f695637778 req-7b0cfd90-3325-4083-b65c-619754c9f57e service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:32.620992 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-33a03378-e1f5-4b8c-8a9c-15f695637778 req-7b0cfd90-3325-4083-b65c-619754c9f57e service nova] Creating event network-changed:2b0baaac-04a3-4147-9d07-17d4bc9c6c36 for instance 1770fd40-dd13-44c5-a045-2552bc5420dd on hv-cinder-83577 Mar 30 07:23:32.627508 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-33a03378-e1f5-4b8c-8a9c-15f695637778 req-7b0cfd90-3325-4083-b65c-619754c9f57e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032951 Mar 30 07:23:32.628942 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 435/849] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:32.633764 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4ee66bd1-ab52-4655-964a-11e2b828c306 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:23:32.753789 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5b6d6f2a-7383-425a-9b85-4a2cb1f1eb08 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:32.754844 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5b6d6f2a-7383-425a-9b85-4a2cb1f1eb08 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:32.766306 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b6d6f2a-7383-425a-9b85-4a2cb1f1eb08 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:32.767455 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b6d6f2a-7383-425a-9b85-4a2cb1f1eb08 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:32.768997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b6d6f2a-7383-425a-9b85-4a2cb1f1eb08 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:32.769730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5b6d6f2a-7383-425a-9b85-4a2cb1f1eb08 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:32.775966 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4ee66bd1-ab52-4655-964a-11e2b828c306 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 204 len: 0 microversion: 2.1 time: 0.186307 Mar 30 07:23:32.776785 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 415/850] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:23:32 2022] DELETE /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:23:32.791258 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c5914289-a580-455a-aff2-d6d3e3fbd61d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:32.795447 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c5914289-a580-455a-aff2-d6d3e3fbd61d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:32.806927 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c5914289-a580-455a-aff2-d6d3e3fbd61d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:32.810591 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c5914289-a580-455a-aff2-d6d3e3fbd61d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:32.811703 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c5914289-a580-455a-aff2-d6d3e3fbd61d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:32.813305 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c5914289-a580-455a-aff2-d6d3e3fbd61d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:33.454160 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c5914289-a580-455a-aff2-d6d3e3fbd61d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:33.459153 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5b6d6f2a-7383-425a-9b85-4a2cb1f1eb08 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:33.463458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c5914289-a580-455a-aff2-d6d3e3fbd61d tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1569 microversion: 2.1 time: 0.680943 Mar 30 07:23:33.465991 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 416/851] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:32 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1569 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:33.467943 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5b6d6f2a-7383-425a-9b85-4a2cb1f1eb08 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1315 microversion: 2.1 time: 0.718756 Mar 30 07:23:33.469434 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 436/852] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:32 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:33.476895 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9452e346-a870-4764-8dcb-db83b0fa15c7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:33.477523 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9452e346-a870-4764-8dcb-db83b0fa15c7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:33.484717 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9452e346-a870-4764-8dcb-db83b0fa15c7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:33.485611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9452e346-a870-4764-8dcb-db83b0fa15c7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:33.486473 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9452e346-a870-4764-8dcb-db83b0fa15c7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:33.486908 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9452e346-a870-4764-8dcb-db83b0fa15c7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:33.770191 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9452e346-a870-4764-8dcb-db83b0fa15c7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:33.777965 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9452e346-a870-4764-8dcb-db83b0fa15c7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1367 microversion: 2.1 time: 0.311031 Mar 30 07:23:33.778520 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 417/853] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:33 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:34.458167 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-d21b9b8a-9a21-4999-a39e-b00425d3da04 req-262e15d8-e264-46d6-a7b6-4dd3f7301df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e27669-29a8-48a3-b442-ee2cc19176c3", "name": "network-vif-plugged", "status": "completed", "tag": "2677b771-ec44-40a5-bd54-2aac9661dc44"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:34.468126 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-d21b9b8a-9a21-4999-a39e-b00425d3da04 req-262e15d8-e264-46d6-a7b6-4dd3f7301df5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:34.468586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-d21b9b8a-9a21-4999-a39e-b00425d3da04 req-262e15d8-e264-46d6-a7b6-4dd3f7301df5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:34.482377 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ad9ef308-cca9-4a75-86b1-1aee67d8dca4 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:34.482635 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-d21b9b8a-9a21-4999-a39e-b00425d3da04 req-262e15d8-e264-46d6-a7b6-4dd3f7301df5 service nova] Creating event network-vif-plugged:2677b771-ec44-40a5-bd54-2aac9661dc44 for instance c4e27669-29a8-48a3-b442-ee2cc19176c3 on hv-cinder-83577 Mar 30 07:23:34.483538 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ad9ef308-cca9-4a75-86b1-1aee67d8dca4 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:34.488433 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-d21b9b8a-9a21-4999-a39e-b00425d3da04 req-262e15d8-e264-46d6-a7b6-4dd3f7301df5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034085 Mar 30 07:23:34.489038 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 437/854] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:34.490954 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ad9ef308-cca9-4a75-86b1-1aee67d8dca4 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:34.491476 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ad9ef308-cca9-4a75-86b1-1aee67d8dca4 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:34.492351 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ad9ef308-cca9-4a75-86b1-1aee67d8dca4 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:34.493183 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ad9ef308-cca9-4a75-86b1-1aee67d8dca4 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:34.495557 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-24658d6b-b6c4-4de6-ab36-9b6bfcc3b6ed tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:34.496599 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-24658d6b-b6c4-4de6-ab36-9b6bfcc3b6ed tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:34.503374 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-24658d6b-b6c4-4de6-ab36-9b6bfcc3b6ed tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:34.503832 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-24658d6b-b6c4-4de6-ab36-9b6bfcc3b6ed tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:34.504618 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-24658d6b-b6c4-4de6-ab36-9b6bfcc3b6ed tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:34.505073 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-24658d6b-b6c4-4de6-ab36-9b6bfcc3b6ed tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:34.790933 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ad9ef308-cca9-4a75-86b1-1aee67d8dca4 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:34.797062 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-24658d6b-b6c4-4de6-ab36-9b6bfcc3b6ed tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:34.800258 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ad9ef308-cca9-4a75-86b1-1aee67d8dca4 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1450 microversion: 2.1 time: 0.322221 Mar 30 07:23:34.801088 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 418/855] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:34 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1450 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:34.810209 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-24658d6b-b6c4-4de6-ab36-9b6bfcc3b6ed tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1315 microversion: 2.1 time: 0.317048 Mar 30 07:23:34.810209 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 438/856] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:34 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:34.815403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f0a8adb6-217c-4f24-b246-02314c6b0a3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:34.816065 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f0a8adb6-217c-4f24-b246-02314c6b0a3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:34.821770 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-121a0407-9bac-4710-8261-1a3abc914cc4 req-f890ec51-f2a6-4a4f-8bc8-12fba6ffcc6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3947af48-d63d-4e02-9ab2-af1fd89015ad", "tag": "ecb92ae1-7dc4-4dff-a922-9a1df625d4ba"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:34.823615 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f0a8adb6-217c-4f24-b246-02314c6b0a3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:34.824469 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f0a8adb6-217c-4f24-b246-02314c6b0a3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:34.825401 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f0a8adb6-217c-4f24-b246-02314c6b0a3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:34.825990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f0a8adb6-217c-4f24-b246-02314c6b0a3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:34.830133 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-121a0407-9bac-4710-8261-1a3abc914cc4 req-f890ec51-f2a6-4a4f-8bc8-12fba6ffcc6a service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:34.830577 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-121a0407-9bac-4710-8261-1a3abc914cc4 req-f890ec51-f2a6-4a4f-8bc8-12fba6ffcc6a service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:34.841580 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-121a0407-9bac-4710-8261-1a3abc914cc4 req-f890ec51-f2a6-4a4f-8bc8-12fba6ffcc6a service nova] Creating event network-changed:ecb92ae1-7dc4-4dff-a922-9a1df625d4ba for instance 3947af48-d63d-4e02-9ab2-af1fd89015ad on hv-cinder-83577 Mar 30 07:23:34.846380 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-121a0407-9bac-4710-8261-1a3abc914cc4 req-f890ec51-f2a6-4a4f-8bc8-12fba6ffcc6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028373 Mar 30 07:23:34.846983 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 439/857] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:35.002217 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f0a8adb6-217c-4f24-b246-02314c6b0a3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:35.009694 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f0a8adb6-217c-4f24-b246-02314c6b0a3d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1367 microversion: 2.1 time: 0.197962 Mar 30 07:23:35.010268 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 419/858] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:34 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:35.194445 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-646add8d-64f5-45a5-990e-4e0e0dfd4b8e req-6373669c-146e-4e2d-bc14-c488eacd1fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770fd40-dd13-44c5-a045-2552bc5420dd", "name": "network-vif-deleted", "tag": "2b0baaac-04a3-4147-9d07-17d4bc9c6c36"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:35.203138 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-646add8d-64f5-45a5-990e-4e0e0dfd4b8e req-6373669c-146e-4e2d-bc14-c488eacd1fc5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:35.203584 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-646add8d-64f5-45a5-990e-4e0e0dfd4b8e req-6373669c-146e-4e2d-bc14-c488eacd1fc5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:35.215202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-646add8d-64f5-45a5-990e-4e0e0dfd4b8e req-6373669c-146e-4e2d-bc14-c488eacd1fc5 service nova] Creating event network-vif-deleted:2b0baaac-04a3-4147-9d07-17d4bc9c6c36 for instance 1770fd40-dd13-44c5-a045-2552bc5420dd on hv-cinder-83577 Mar 30 07:23:35.220551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-646add8d-64f5-45a5-990e-4e0e0dfd4b8e req-6373669c-146e-4e2d-bc14-c488eacd1fc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 Mar 30 07:23:35.221136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 440/859] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:35.818512 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:35.820492 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:35.827044 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6393b3d3-6b80-4ec1-a30a-78b6d3bded02 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:35.827829 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6393b3d3-6b80-4ec1-a30a-78b6d3bded02 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:35.836718 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:35.837156 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:35.837988 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:35.841930 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6393b3d3-6b80-4ec1-a30a-78b6d3bded02 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:35.842371 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6393b3d3-6b80-4ec1-a30a-78b6d3bded02 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:35.843171 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6393b3d3-6b80-4ec1-a30a-78b6d3bded02 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:35.843601 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6393b3d3-6b80-4ec1-a30a-78b6d3bded02 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:35.847813 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:35.880942 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:35.881386 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:35.881830 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lazy-loading 'fault' on Instance uuid 1770fd40-dd13-44c5-a045-2552bc5420dd {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:23:35.940426 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034481ab42c4890a835c6876d7fcca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b879ef71fe5494cadf6882b4230511a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:35.948726 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-dcf246dd-f9a6-48e9-a53d-3020c1fb64ba tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 200 len: 1224 microversion: 2.1 time: 0.134485 Mar 30 07:23:35.949753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 420/860] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:35 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 1224 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:36.019503 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-6393b3d3-6b80-4ec1-a30a-78b6d3bded02 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:36.027074 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-6c239aaa-f3d2-491e-b390-ae4caecfc274 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:36.027995 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-6c239aaa-f3d2-491e-b390-ae4caecfc274 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:36.033832 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6393b3d3-6b80-4ec1-a30a-78b6d3bded02 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1315 microversion: 2.1 time: 0.211949 Mar 30 07:23:36.043577 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c239aaa-f3d2-491e-b390-ae4caecfc274 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:36.043766 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 441/861] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:35 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:36.043913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c239aaa-f3d2-491e-b390-ae4caecfc274 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:36.043913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c239aaa-f3d2-491e-b390-ae4caecfc274 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:36.043913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-6c239aaa-f3d2-491e-b390-ae4caecfc274 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:36.176872 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-6c239aaa-f3d2-491e-b390-ae4caecfc274 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:36.184602 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-6c239aaa-f3d2-491e-b390-ae4caecfc274 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1367 microversion: 2.1 time: 0.161792 Mar 30 07:23:36.185189 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 421/862] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:36 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:23:36.969331 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:36.969960 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] [instance: 1770fd40-dd13-44c5-a045-2552bc5420dd] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:36.979569 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:36.980153 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:36.981185 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:36.981626 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:36.997570 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] HTTP exception thrown: Instance 1770fd40-dd13-44c5-a045-2552bc5420dd could not be found. Mar 30 07:23:36.998159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Returning 404 to user: Instance 1770fd40-dd13-44c5-a045-2552bc5420dd could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:23:36.998994 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-75a23423-eb55-4118-aaad-b3a6e9348b67 tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd" status: 404 len: 111 microversion: 2.1 time: 0.036150 Mar 30 07:23:36.999539 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 442/863] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:36 2022] GET /compute/v2.1/servers/1770fd40-dd13-44c5-a045-2552bc5420dd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:23:37.051315 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2d7a47e4-97e1-438c-b7fb-eb5b16b7ba7b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:37.051925 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2d7a47e4-97e1-438c-b7fb-eb5b16b7ba7b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:37.058501 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2d7a47e4-97e1-438c-b7fb-eb5b16b7ba7b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:37.058949 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2d7a47e4-97e1-438c-b7fb-eb5b16b7ba7b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:37.060091 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2d7a47e4-97e1-438c-b7fb-eb5b16b7ba7b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:37.060523 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2d7a47e4-97e1-438c-b7fb-eb5b16b7ba7b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:37.174817 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bdfc1c52-5067-47e1-939d-1996af75a14c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] Calling method '.version_select at 0x7f154d07e550>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:37.215357 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bdfc1c52-5067-47e1-939d-1996af75a14c tempest-TestShelveInstance-1134245756 tempest-TestShelveInstance-1134245756-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1995633863" status: 202 len: 0 microversion: 2.1 time: 0.048001 Mar 30 07:23:37.216777 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 443/864] 10.222.0.20 () {58 vars in 1253 bytes} [Wed Mar 30 07:23:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1995633863 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:23:37.233266 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-200c1b48-9713-422f-8213-54e50cd291bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:37.233895 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-200c1b48-9713-422f-8213-54e50cd291bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:37.240649 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-200c1b48-9713-422f-8213-54e50cd291bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:37.241330 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-200c1b48-9713-422f-8213-54e50cd291bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:37.242447 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-200c1b48-9713-422f-8213-54e50cd291bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:37.243032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-200c1b48-9713-422f-8213-54e50cd291bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:37.261857 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2d7a47e4-97e1-438c-b7fb-eb5b16b7ba7b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:37.276734 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2d7a47e4-97e1-438c-b7fb-eb5b16b7ba7b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1315 microversion: 2.1 time: 0.229006 Mar 30 07:23:37.282268 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 422/865] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:37 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:37.408174 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-200c1b48-9713-422f-8213-54e50cd291bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:37.417209 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-200c1b48-9713-422f-8213-54e50cd291bb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1557 microversion: 2.1 time: 0.198897 Mar 30 07:23:37.417777 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 444/866] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:37 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1557 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:37.434750 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9ff89f06-00cf-4797-8812-23138b365d31 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:37.435393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9ff89f06-00cf-4797-8812-23138b365d31 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:37.442002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9ff89f06-00cf-4797-8812-23138b365d31 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:37.442629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9ff89f06-00cf-4797-8812-23138b365d31 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:37.443516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9ff89f06-00cf-4797-8812-23138b365d31 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:37.444096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9ff89f06-00cf-4797-8812-23138b365d31 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:37.533496 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9ff89f06-00cf-4797-8812-23138b365d31 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102921 Mar 30 07:23:37.534183 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 423/867] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Mar 30 07:23:37 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:38.301629 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-937be77b-aad4-411a-97e9-089f3df390ad tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:38.302399 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-937be77b-aad4-411a-97e9-089f3df390ad tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:38.309470 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-937be77b-aad4-411a-97e9-089f3df390ad tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:38.309932 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-937be77b-aad4-411a-97e9-089f3df390ad tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:38.310759 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-937be77b-aad4-411a-97e9-089f3df390ad tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:38.311615 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-937be77b-aad4-411a-97e9-089f3df390ad tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:38.648257 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-937be77b-aad4-411a-97e9-089f3df390ad tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:38.657136 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-937be77b-aad4-411a-97e9-089f3df390ad tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1315 microversion: 2.1 time: 0.361742 Mar 30 07:23:38.664098 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-86ee4535-85ed-4d06-9f93-cf2063457726 req-99d4a888-da4d-4003-8c55-b530e08b5655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e27669-29a8-48a3-b442-ee2cc19176c3", "tag": "2677b771-ec44-40a5-bd54-2aac9661dc44"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:38.672231 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 445/868] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:38 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:38.679786 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-86ee4535-85ed-4d06-9f93-cf2063457726 req-99d4a888-da4d-4003-8c55-b530e08b5655 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:38.680535 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-86ee4535-85ed-4d06-9f93-cf2063457726 req-99d4a888-da4d-4003-8c55-b530e08b5655 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:38.694249 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-86ee4535-85ed-4d06-9f93-cf2063457726 req-99d4a888-da4d-4003-8c55-b530e08b5655 service nova] Creating event network-changed:2677b771-ec44-40a5-bd54-2aac9661dc44 for instance c4e27669-29a8-48a3-b442-ee2cc19176c3 on hv-cinder-83577 Mar 30 07:23:38.701976 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-86ee4535-85ed-4d06-9f93-cf2063457726 req-99d4a888-da4d-4003-8c55-b530e08b5655 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041667 Mar 30 07:23:38.703210 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 424/869] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:23:39.688504 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d7c8a7c7-1fd8-4b36-b4b1-889d1da1fe46 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:39.689210 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d7c8a7c7-1fd8-4b36-b4b1-889d1da1fe46 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:39.698967 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d7c8a7c7-1fd8-4b36-b4b1-889d1da1fe46 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:39.699900 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d7c8a7c7-1fd8-4b36-b4b1-889d1da1fe46 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:39.700827 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d7c8a7c7-1fd8-4b36-b4b1-889d1da1fe46 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:39.701262 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d7c8a7c7-1fd8-4b36-b4b1-889d1da1fe46 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:39.957157 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d7c8a7c7-1fd8-4b36-b4b1-889d1da1fe46 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:39.965042 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d7c8a7c7-1fd8-4b36-b4b1-889d1da1fe46 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1315 microversion: 2.1 time: 0.281045 Mar 30 07:23:39.965640 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 446/870] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:39 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:40.567323 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-9e9e55d2-a9dc-41a8-90bd-5053dbf137cc req-f118e567-9c24-4a13-a328-eb8157322e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3947af48-d63d-4e02-9ab2-af1fd89015ad", "name": "network-vif-plugged", "status": "completed", "tag": "ecb92ae1-7dc4-4dff-a922-9a1df625d4ba"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:40.577206 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-9e9e55d2-a9dc-41a8-90bd-5053dbf137cc req-f118e567-9c24-4a13-a328-eb8157322e3e service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:40.578211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-9e9e55d2-a9dc-41a8-90bd-5053dbf137cc req-f118e567-9c24-4a13-a328-eb8157322e3e service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:40.590968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-9e9e55d2-a9dc-41a8-90bd-5053dbf137cc req-f118e567-9c24-4a13-a328-eb8157322e3e service nova] Creating event network-vif-plugged:ecb92ae1-7dc4-4dff-a922-9a1df625d4ba for instance 3947af48-d63d-4e02-9ab2-af1fd89015ad on hv-cinder-83577 Mar 30 07:23:40.596599 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-9e9e55d2-a9dc-41a8-90bd-5053dbf137cc req-f118e567-9c24-4a13-a328-eb8157322e3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034263 Mar 30 07:23:40.598139 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 425/871] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:40.992109 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0ec5fab1-936c-4cdd-be4c-7c82096a5c06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:40.995257 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0ec5fab1-936c-4cdd-be4c-7c82096a5c06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:41.009078 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0ec5fab1-936c-4cdd-be4c-7c82096a5c06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:41.009523 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0ec5fab1-936c-4cdd-be4c-7c82096a5c06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:41.010305 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0ec5fab1-936c-4cdd-be4c-7c82096a5c06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:41.010740 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0ec5fab1-936c-4cdd-be4c-7c82096a5c06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:41.266511 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0ec5fab1-936c-4cdd-be4c-7c82096a5c06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:41.275223 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0ec5fab1-936c-4cdd-be4c-7c82096a5c06 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1315 microversion: 2.1 time: 0.295421 Mar 30 07:23:41.276282 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 447/872] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:40 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:42.300349 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9bfe4a50-ac6a-40c4-a1de-1578f0a1340b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:42.301034 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9bfe4a50-ac6a-40c4-a1de-1578f0a1340b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:42.309402 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9bfe4a50-ac6a-40c4-a1de-1578f0a1340b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:42.309817 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9bfe4a50-ac6a-40c4-a1de-1578f0a1340b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:42.310792 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9bfe4a50-ac6a-40c4-a1de-1578f0a1340b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:42.311208 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9bfe4a50-ac6a-40c4-a1de-1578f0a1340b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:42.456577 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9bfe4a50-ac6a-40c4-a1de-1578f0a1340b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:42.464080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9bfe4a50-ac6a-40c4-a1de-1578f0a1340b tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1465 microversion: 2.1 time: 0.174531 Mar 30 07:23:42.464730 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 426/873] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:42 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1465 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:42.503312 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ce6ba6bb-730a-4259-a3dc-2990b50cd2ca tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:42.503825 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ce6ba6bb-730a-4259-a3dc-2990b50cd2ca tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:42.510101 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6bb-730a-4259-a3dc-2990b50cd2ca tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:42.510582 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6bb-730a-4259-a3dc-2990b50cd2ca tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:42.511351 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6bb-730a-4259-a3dc-2990b50cd2ca tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:42.511800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6bb-730a-4259-a3dc-2990b50cd2ca tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:42.536190 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ce6ba6bb-730a-4259-a3dc-2990b50cd2ca tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:23:42.616637 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ce6ba6bb-730a-4259-a3dc-2990b50cd2ca tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 204 len: 0 microversion: 2.1 time: 0.117013 Mar 30 07:23:42.619251 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 448/874] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:23:42 2022] DELETE /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:23:42.627602 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ed37f6b0-ead8-4a56-8cf1-9c1bbc9d9428 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:42.628243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ed37f6b0-ead8-4a56-8cf1-9c1bbc9d9428 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:42.634040 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ed37f6b0-ead8-4a56-8cf1-9c1bbc9d9428 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:42.634481 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ed37f6b0-ead8-4a56-8cf1-9c1bbc9d9428 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:42.635240 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ed37f6b0-ead8-4a56-8cf1-9c1bbc9d9428 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:42.635668 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ed37f6b0-ead8-4a56-8cf1-9c1bbc9d9428 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:42.776358 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ed37f6b0-ead8-4a56-8cf1-9c1bbc9d9428 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:42.784575 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ed37f6b0-ead8-4a56-8cf1-9c1bbc9d9428 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1471 microversion: 2.1 time: 0.160695 Mar 30 07:23:42.785163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 427/875] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:42 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:43.440482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-56fc2bd5-2e05-4770-8ea8-70bd3ac62dd5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:43.446173 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-56fc2bd5-2e05-4770-8ea8-70bd3ac62dd5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:43.452736 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56fc2bd5-2e05-4770-8ea8-70bd3ac62dd5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:43.453297 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56fc2bd5-2e05-4770-8ea8-70bd3ac62dd5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:43.454322 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56fc2bd5-2e05-4770-8ea8-70bd3ac62dd5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:43.454959 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-56fc2bd5-2e05-4770-8ea8-70bd3ac62dd5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:43.539482 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-56fc2bd5-2e05-4770-8ea8-70bd3ac62dd5 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "POST /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/action" status: 202 len: 0 microversion: 2.1 time: 0.103749 Mar 30 07:23:43.544401 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 449/876] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:23:43 2022] POST /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:23:43.551446 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-179e18a5-297e-40fe-a887-5094218893d8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:43.553035 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-179e18a5-297e-40fe-a887-5094218893d8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:43.565771 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-179e18a5-297e-40fe-a887-5094218893d8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:43.566894 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-179e18a5-297e-40fe-a887-5094218893d8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:43.568037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-179e18a5-297e-40fe-a887-5094218893d8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:43.568571 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-179e18a5-297e-40fe-a887-5094218893d8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:43.803505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-85b1bdc7-d810-4483-864c-8da1e3cf70bc tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:43.804325 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-85b1bdc7-d810-4483-864c-8da1e3cf70bc tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:43.811151 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-85b1bdc7-d810-4483-864c-8da1e3cf70bc tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:43.812011 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-85b1bdc7-d810-4483-864c-8da1e3cf70bc tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:43.813027 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-85b1bdc7-d810-4483-864c-8da1e3cf70bc tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:43.813676 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-85b1bdc7-d810-4483-864c-8da1e3cf70bc tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:43.828817 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-179e18a5-297e-40fe-a887-5094218893d8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:43.839510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-179e18a5-297e-40fe-a887-5094218893d8 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1751 microversion: 2.1 time: 0.290397 Mar 30 07:23:43.841008 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 428/877] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:43 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1751 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:44.056237 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-85b1bdc7-d810-4483-864c-8da1e3cf70bc tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:44.064094 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-85b1bdc7-d810-4483-864c-8da1e3cf70bc tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1471 microversion: 2.1 time: 0.265474 Mar 30 07:23:44.074057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 450/878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:43 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:44.858322 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a6c1bcff-63a0-47ee-8d6f-8f4127566dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:44.858906 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a6c1bcff-63a0-47ee-8d6f-8f4127566dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:44.865530 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6c1bcff-63a0-47ee-8d6f-8f4127566dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:44.865984 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6c1bcff-63a0-47ee-8d6f-8f4127566dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:44.866762 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6c1bcff-63a0-47ee-8d6f-8f4127566dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:44.867216 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a6c1bcff-63a0-47ee-8d6f-8f4127566dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:45.059109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-a6c1bcff-63a0-47ee-8d6f-8f4127566dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:45.073839 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a6c1bcff-63a0-47ee-8d6f-8f4127566dac tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.219495 Mar 30 07:23:45.084856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 429/879] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:44 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:45.085827 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7746fb47-a7e8-4b5e-8811-042ca8cfee64 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:45.086653 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7746fb47-a7e8-4b5e-8811-042ca8cfee64 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:45.109305 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7746fb47-a7e8-4b5e-8811-042ca8cfee64 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:45.110629 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7746fb47-a7e8-4b5e-8811-042ca8cfee64 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:45.111427 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7746fb47-a7e8-4b5e-8811-042ca8cfee64 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:45.111916 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7746fb47-a7e8-4b5e-8811-042ca8cfee64 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:45.168125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-d55d2b07-7343-494b-bba5-9313f80c3428 req-c08f4f9d-aaeb-4c4f-98ce-54d3de745982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3947af48-d63d-4e02-9ab2-af1fd89015ad", "name": "network-vif-deleted", "tag": "ecb92ae1-7dc4-4dff-a922-9a1df625d4ba"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:23:45.184863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-d55d2b07-7343-494b-bba5-9313f80c3428 req-c08f4f9d-aaeb-4c4f-98ce-54d3de745982 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:45.185464 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-d55d2b07-7343-494b-bba5-9313f80c3428 req-c08f4f9d-aaeb-4c4f-98ce-54d3de745982 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:45.224713 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-7746fb47-a7e8-4b5e-8811-042ca8cfee64 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315896d65bea44dda7c1a74a9d0612ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c15e6913c445c3be0d970eedf206ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:45.238242 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7746fb47-a7e8-4b5e-8811-042ca8cfee64 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 200 len: 1429 microversion: 2.1 time: 0.158154 Mar 30 07:23:45.239301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 451/880] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:45 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 1429 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:45.240134 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-d55d2b07-7343-494b-bba5-9313f80c3428 req-c08f4f9d-aaeb-4c4f-98ce-54d3de745982 service nova] Creating event network-vif-deleted:ecb92ae1-7dc4-4dff-a922-9a1df625d4ba for instance 3947af48-d63d-4e02-9ab2-af1fd89015ad on hv-cinder-83577 Mar 30 07:23:45.251207 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-d55d2b07-7343-494b-bba5-9313f80c3428 req-c08f4f9d-aaeb-4c4f-98ce-54d3de745982 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087064 Mar 30 07:23:45.252403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 430/881] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:23:46.092899 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2adf0365-3c15-463e-83c3-85375128c161 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:46.093612 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2adf0365-3c15-463e-83c3-85375128c161 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:46.100144 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2adf0365-3c15-463e-83c3-85375128c161 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:46.100596 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2adf0365-3c15-463e-83c3-85375128c161 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:46.101885 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2adf0365-3c15-463e-83c3-85375128c161 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:46.102580 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2adf0365-3c15-463e-83c3-85375128c161 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:46.258142 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:46.259021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] [instance: 3947af48-d63d-4e02-9ab2-af1fd89015ad] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:46.263510 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2adf0365-3c15-463e-83c3-85375128c161 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:46.265886 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:46.266339 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:46.267338 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:46.267979 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:46.272220 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2adf0365-3c15-463e-83c3-85375128c161 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.184343 Mar 30 07:23:46.272800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 452/882] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:46 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:46.284037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] HTTP exception thrown: Instance 3947af48-d63d-4e02-9ab2-af1fd89015ad could not be found. Mar 30 07:23:46.284037 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] Returning 404 to user: Instance 3947af48-d63d-4e02-9ab2-af1fd89015ad could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:23:46.284592 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-75820b3b-64d6-40ff-b78c-f2efde2f4370 tempest-VolumesNegativeTest-162294101 tempest-VolumesNegativeTest-162294101-project] 10.222.0.20 "GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad" status: 404 len: 111 microversion: 2.1 time: 0.032374 Mar 30 07:23:46.285140 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 431/883] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:46 2022] GET /compute/v2.1/servers/3947af48-d63d-4e02-9ab2-af1fd89015ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 30 07:23:47.290124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-27ed632e-5980-49e6-98a8-a20e6c2234ea tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:47.290843 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-27ed632e-5980-49e6-98a8-a20e6c2234ea tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:47.297776 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27ed632e-5980-49e6-98a8-a20e6c2234ea tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:47.298402 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27ed632e-5980-49e6-98a8-a20e6c2234ea tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:47.298966 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27ed632e-5980-49e6-98a8-a20e6c2234ea tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:47.299422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-27ed632e-5980-49e6-98a8-a20e6c2234ea tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:47.458588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-27ed632e-5980-49e6-98a8-a20e6c2234ea tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:47.466420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-27ed632e-5980-49e6-98a8-a20e6c2234ea tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.180435 Mar 30 07:23:47.467158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 453/884] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:47 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:48.483659 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-966086ea-4167-4e8d-a0ab-59a89ea9f4b6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:48.484269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-966086ea-4167-4e8d-a0ab-59a89ea9f4b6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:48.491315 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-966086ea-4167-4e8d-a0ab-59a89ea9f4b6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:48.491767 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-966086ea-4167-4e8d-a0ab-59a89ea9f4b6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:48.492582 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-966086ea-4167-4e8d-a0ab-59a89ea9f4b6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:48.493014 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-966086ea-4167-4e8d-a0ab-59a89ea9f4b6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:48.649790 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-966086ea-4167-4e8d-a0ab-59a89ea9f4b6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:48.657989 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-966086ea-4167-4e8d-a0ab-59a89ea9f4b6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.178257 Mar 30 07:23:48.658529 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 432/885] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:48 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:49.679379 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-65c5ad73-3412-4c07-b84e-5a67290315cd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:49.680388 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-65c5ad73-3412-4c07-b84e-5a67290315cd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:49.692040 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65c5ad73-3412-4c07-b84e-5a67290315cd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:49.692743 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65c5ad73-3412-4c07-b84e-5a67290315cd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:49.693996 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65c5ad73-3412-4c07-b84e-5a67290315cd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:49.694708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-65c5ad73-3412-4c07-b84e-5a67290315cd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:49.852958 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-65c5ad73-3412-4c07-b84e-5a67290315cd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:49.862036 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-65c5ad73-3412-4c07-b84e-5a67290315cd tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.189093 Mar 30 07:23:49.862581 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 454/886] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:49 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:50.884735 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-82c08f02-47cd-4f21-9843-f89fd254d32a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:50.885762 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-82c08f02-47cd-4f21-9843-f89fd254d32a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:50.893092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82c08f02-47cd-4f21-9843-f89fd254d32a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:50.893540 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82c08f02-47cd-4f21-9843-f89fd254d32a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:50.894297 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82c08f02-47cd-4f21-9843-f89fd254d32a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:50.894722 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-82c08f02-47cd-4f21-9843-f89fd254d32a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:51.045393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-82c08f02-47cd-4f21-9843-f89fd254d32a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:51.053389 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-82c08f02-47cd-4f21-9843-f89fd254d32a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.172611 Mar 30 07:23:51.053959 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 433/887] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:50 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:52.076931 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-33f79b4c-f9ca-4d0f-982c-bfa8e5b2552d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:52.077542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-33f79b4c-f9ca-4d0f-982c-bfa8e5b2552d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:52.084542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-33f79b4c-f9ca-4d0f-982c-bfa8e5b2552d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:52.085124 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-33f79b4c-f9ca-4d0f-982c-bfa8e5b2552d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:52.085997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-33f79b4c-f9ca-4d0f-982c-bfa8e5b2552d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:52.086428 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-33f79b4c-f9ca-4d0f-982c-bfa8e5b2552d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:52.253128 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-33f79b4c-f9ca-4d0f-982c-bfa8e5b2552d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:52.266013 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-33f79b4c-f9ca-4d0f-982c-bfa8e5b2552d tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.194422 Mar 30 07:23:52.267038 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 455/888] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:52 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:53.292997 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-248d27d7-da6d-4fca-86d3-49adf7979320 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:53.293998 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-248d27d7-da6d-4fca-86d3-49adf7979320 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:53.301522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-248d27d7-da6d-4fca-86d3-49adf7979320 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:53.301978 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-248d27d7-da6d-4fca-86d3-49adf7979320 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:53.302744 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-248d27d7-da6d-4fca-86d3-49adf7979320 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:53.303170 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-248d27d7-da6d-4fca-86d3-49adf7979320 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:53.464254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-248d27d7-da6d-4fca-86d3-49adf7979320 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:53.477425 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-248d27d7-da6d-4fca-86d3-49adf7979320 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.190738 Mar 30 07:23:53.478021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 434/889] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:53 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:54.501114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-02918e93-56ec-4ffd-ace4-a1297d3e7534 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:54.501759 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-02918e93-56ec-4ffd-ace4-a1297d3e7534 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:54.509551 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-02918e93-56ec-4ffd-ace4-a1297d3e7534 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:54.510071 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-02918e93-56ec-4ffd-ace4-a1297d3e7534 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:54.510967 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-02918e93-56ec-4ffd-ace4-a1297d3e7534 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:54.511466 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-02918e93-56ec-4ffd-ace4-a1297d3e7534 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:54.671324 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-02918e93-56ec-4ffd-ace4-a1297d3e7534 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:54.679268 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-02918e93-56ec-4ffd-ace4-a1297d3e7534 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.184453 Mar 30 07:23:54.679847 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 456/890] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:54 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:55.701203 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f96419a9-c961-49f6-a08d-5be922f76a45 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:55.702328 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-f96419a9-c961-49f6-a08d-5be922f76a45 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:55.709859 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f96419a9-c961-49f6-a08d-5be922f76a45 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:55.710575 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f96419a9-c961-49f6-a08d-5be922f76a45 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:55.711471 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f96419a9-c961-49f6-a08d-5be922f76a45 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:55.712068 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-f96419a9-c961-49f6-a08d-5be922f76a45 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:55.868253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-f96419a9-c961-49f6-a08d-5be922f76a45 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:55.878317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f96419a9-c961-49f6-a08d-5be922f76a45 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.183694 Mar 30 07:23:55.878901 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 435/891] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:55 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:56.899548 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9fdbcd0d-2907-4c05-bb1b-be7476060d4f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:56.900595 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9fdbcd0d-2907-4c05-bb1b-be7476060d4f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:56.908818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9fdbcd0d-2907-4c05-bb1b-be7476060d4f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:56.909260 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9fdbcd0d-2907-4c05-bb1b-be7476060d4f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:56.910023 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9fdbcd0d-2907-4c05-bb1b-be7476060d4f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:56.910447 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9fdbcd0d-2907-4c05-bb1b-be7476060d4f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:57.084938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9fdbcd0d-2907-4c05-bb1b-be7476060d4f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:57.093730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9fdbcd0d-2907-4c05-bb1b-be7476060d4f tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.200137 Mar 30 07:23:57.094286 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 457/892] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:56 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:58.117153 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-464c215c-5f0a-4c13-8afd-9530f764133b tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:58.117747 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-464c215c-5f0a-4c13-8afd-9530f764133b tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:58.124884 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-464c215c-5f0a-4c13-8afd-9530f764133b tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:58.125333 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-464c215c-5f0a-4c13-8afd-9530f764133b tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:58.126109 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-464c215c-5f0a-4c13-8afd-9530f764133b tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:58.126548 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-464c215c-5f0a-4c13-8afd-9530f764133b tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:58.282673 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-464c215c-5f0a-4c13-8afd-9530f764133b tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:58.291333 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-464c215c-5f0a-4c13-8afd-9530f764133b tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.178165 Mar 30 07:23:58.291971 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 436/893] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:58 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:23:59.309132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3558b664-eceb-4cae-b500-4f1556bc9540 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:23:59.310499 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3558b664-eceb-4cae-b500-4f1556bc9540 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:23:59.317221 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3558b664-eceb-4cae-b500-4f1556bc9540 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:59.317808 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3558b664-eceb-4cae-b500-4f1556bc9540 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:59.318702 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3558b664-eceb-4cae-b500-4f1556bc9540 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:23:59.319210 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3558b664-eceb-4cae-b500-4f1556bc9540 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:23:59.490743 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3558b664-eceb-4cae-b500-4f1556bc9540 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:23:59.499236 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3558b664-eceb-4cae-b500-4f1556bc9540 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.194114 Mar 30 07:23:59.500032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 458/894] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:23:59 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:00.520362 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7a467616-aa9e-40e1-9bad-566821f1ffa9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:00.521210 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7a467616-aa9e-40e1-9bad-566821f1ffa9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:00.531254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7a467616-aa9e-40e1-9bad-566821f1ffa9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:00.531688 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7a467616-aa9e-40e1-9bad-566821f1ffa9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:00.532482 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7a467616-aa9e-40e1-9bad-566821f1ffa9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:00.532905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7a467616-aa9e-40e1-9bad-566821f1ffa9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:00.685799 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7a467616-aa9e-40e1-9bad-566821f1ffa9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:00.694769 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7a467616-aa9e-40e1-9bad-566821f1ffa9 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.181121 Mar 30 07:24:00.695294 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 437/895] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:00 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:01.721878 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1e55aa94-6364-45a3-a124-b01696b156f6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:01.722889 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1e55aa94-6364-45a3-a124-b01696b156f6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:01.733562 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e55aa94-6364-45a3-a124-b01696b156f6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:01.734013 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e55aa94-6364-45a3-a124-b01696b156f6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:01.734783 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e55aa94-6364-45a3-a124-b01696b156f6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:01.735214 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e55aa94-6364-45a3-a124-b01696b156f6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:01.886200 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1e55aa94-6364-45a3-a124-b01696b156f6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:01.898050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1e55aa94-6364-45a3-a124-b01696b156f6 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1756 microversion: 2.1 time: 0.182680 Mar 30 07:24:01.898784 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 459/896] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:01 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:02.923503 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-05c51ab5-2c7e-490a-b1e9-983da2e38cca tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:02.924789 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-05c51ab5-2c7e-490a-b1e9-983da2e38cca tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:02.931615 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-05c51ab5-2c7e-490a-b1e9-983da2e38cca tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:02.932087 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-05c51ab5-2c7e-490a-b1e9-983da2e38cca tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:02.932854 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-05c51ab5-2c7e-490a-b1e9-983da2e38cca tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:02.933307 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-05c51ab5-2c7e-490a-b1e9-983da2e38cca tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:03.095161 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-05c51ab5-2c7e-490a-b1e9-983da2e38cca tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:03.103652 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-05c51ab5-2c7e-490a-b1e9-983da2e38cca tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1759 microversion: 2.1 time: 0.184463 Mar 30 07:24:03.104285 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 438/897] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:02 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:15.034938 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-76b6eb87-5065-4e49-98d7-977a2ae9a7af tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:15.035719 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-76b6eb87-5065-4e49-98d7-977a2ae9a7af tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:15.045044 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76b6eb87-5065-4e49-98d7-977a2ae9a7af tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:15.045712 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76b6eb87-5065-4e49-98d7-977a2ae9a7af tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:15.046896 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76b6eb87-5065-4e49-98d7-977a2ae9a7af tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:15.047552 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76b6eb87-5065-4e49-98d7-977a2ae9a7af tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:15.072479 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-76b6eb87-5065-4e49-98d7-977a2ae9a7af tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3/ips" status: 200 len: 150 microversion: 2.1 time: 0.043442 Mar 30 07:24:15.073024 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 460/898] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:24:15 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:15.084656 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76aafcd8-da6d-4b7a-9bd9-7c54a75ef28d"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:15.085773 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:15.091998 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:15.092451 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:15.093215 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:15.093649 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:15.183460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Invalid volume: volume 76aafcd8-da6d-4b7a-9bd9-7c54a75ef28d is already attached to instances: fb553a5a-a341-4f34-9d09-4082d87fc076 Mar 30 07:24:15.184100 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 400 to user: Invalid volume: volume 76aafcd8-da6d-4b7a-9bd9-7c54a75ef28d is already attached to instances: fb553a5a-a341-4f34-9d09-4082d87fc076 {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:24:15.184949 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-8db75935-889f-4389-a364-d045b9df8bb6 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104509 Mar 30 07:24:15.185526 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 439/899] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:24:15 2022] POST /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:24:15.195764 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2868c3bb-cb2b-4441-82b2-d941d482115c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:15.196293 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2868c3bb-cb2b-4441-82b2-d941d482115c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:15.202328 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2868c3bb-cb2b-4441-82b2-d941d482115c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:15.202805 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2868c3bb-cb2b-4441-82b2-d941d482115c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:15.203560 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2868c3bb-cb2b-4441-82b2-d941d482115c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:15.204458 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2868c3bb-cb2b-4441-82b2-d941d482115c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:15.231253 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2868c3bb-cb2b-4441-82b2-d941d482115c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:24:15.312448 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2868c3bb-cb2b-4441-82b2-d941d482115c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 204 len: 0 microversion: 2.1 time: 0.120219 Mar 30 07:24:15.313121 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 461/900] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:24:15 2022] DELETE /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:24:15.322955 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3443d5ed-17de-4005-b3ee-157092ac5867 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:15.323587 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3443d5ed-17de-4005-b3ee-157092ac5867 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:15.329832 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3443d5ed-17de-4005-b3ee-157092ac5867 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:15.330297 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3443d5ed-17de-4005-b3ee-157092ac5867 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:15.331201 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3443d5ed-17de-4005-b3ee-157092ac5867 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:15.331608 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3443d5ed-17de-4005-b3ee-157092ac5867 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:15.473767 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3443d5ed-17de-4005-b3ee-157092ac5867 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:15.481860 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3443d5ed-17de-4005-b3ee-157092ac5867 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1682 microversion: 2.1 time: 0.163195 Mar 30 07:24:15.482420 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 440/901] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:15 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:16.510654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5ae7d0b7-be9c-44c9-9069-e601a9712d5a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:16.512005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5ae7d0b7-be9c-44c9-9069-e601a9712d5a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:16.521906 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ae7d0b7-be9c-44c9-9069-e601a9712d5a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:16.522351 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ae7d0b7-be9c-44c9-9069-e601a9712d5a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:16.523101 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ae7d0b7-be9c-44c9-9069-e601a9712d5a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:16.523529 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5ae7d0b7-be9c-44c9-9069-e601a9712d5a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:16.672734 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-5ae7d0b7-be9c-44c9-9069-e601a9712d5a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:16.681302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5ae7d0b7-be9c-44c9-9069-e601a9712d5a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1682 microversion: 2.1 time: 0.178655 Mar 30 07:24:16.681879 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 462/902] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:16 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:17.698883 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2c24680f-a455-43ae-a3bf-75e8155d201a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:17.699502 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2c24680f-a455-43ae-a3bf-75e8155d201a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:17.706347 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c24680f-a455-43ae-a3bf-75e8155d201a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:17.706806 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c24680f-a455-43ae-a3bf-75e8155d201a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:17.707555 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c24680f-a455-43ae-a3bf-75e8155d201a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:17.708023 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2c24680f-a455-43ae-a3bf-75e8155d201a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:17.770644 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2c24680f-a455-43ae-a3bf-75e8155d201a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:17.778369 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2c24680f-a455-43ae-a3bf-75e8155d201a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 200 len: 1614 microversion: 2.1 time: 0.083416 Mar 30 07:24:17.778952 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 441/903] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:17 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:17.859795 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-a9cbca53-b6a9-42f3-9827-7f0615019a34 req-b6bc5254-ea40-4193-84e7-63d85e8824cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e27669-29a8-48a3-b442-ee2cc19176c3", "name": "network-vif-deleted", "tag": "2677b771-ec44-40a5-bd54-2aac9661dc44"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:17.868826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a9cbca53-b6a9-42f3-9827-7f0615019a34 req-b6bc5254-ea40-4193-84e7-63d85e8824cf service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:17.869319 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-a9cbca53-b6a9-42f3-9827-7f0615019a34 req-b6bc5254-ea40-4193-84e7-63d85e8824cf service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:17.880664 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-a9cbca53-b6a9-42f3-9827-7f0615019a34 req-b6bc5254-ea40-4193-84e7-63d85e8824cf service nova] Creating event network-vif-deleted:2677b771-ec44-40a5-bd54-2aac9661dc44 for instance c4e27669-29a8-48a3-b442-ee2cc19176c3 on hv-cinder-83577 Mar 30 07:24:17.885457 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-a9cbca53-b6a9-42f3-9827-7f0615019a34 req-b6bc5254-ea40-4193-84e7-63d85e8824cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029321 Mar 30 07:24:17.889275 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 463/904] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:18.796072 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:18.796664 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:18.804560 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:18.805022 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:18.805813 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:18.806257 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:18.822296 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance c4e27669-29a8-48a3-b442-ee2cc19176c3 could not be found. Mar 30 07:24:18.822902 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance c4e27669-29a8-48a3-b442-ee2cc19176c3 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:24:18.823766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-669517b5-ffb0-46b9-b20b-b6382b8874dd tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 404 len: 111 microversion: 2.1 time: 0.031806 Mar 30 07:24:18.824330 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 442/905] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:18 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:24:18.833759 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ce80e272-5573-4814-9ea3-631726013cb8 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '.version_select at 0x7f154d13b1f0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:18.853285 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ce80e272-5573-4814-9ea3-631726013cb8 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916623287" status: 202 len: 0 microversion: 2.1 time: 0.024041 Mar 30 07:24:18.853861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 464/906] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Mar 30 07:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916623287 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:24:19.562865 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4b793254-0bed-4358-b2d0-b7d2ca4ec774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:19.563357 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4b793254-0bed-4358-b2d0-b7d2ca4ec774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:19.570191 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4b793254-0bed-4358-b2d0-b7d2ca4ec774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:19.570696 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4b793254-0bed-4358-b2d0-b7d2ca4ec774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:19.571494 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4b793254-0bed-4358-b2d0-b7d2ca4ec774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:19.572031 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4b793254-0bed-4358-b2d0-b7d2ca4ec774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:19.651998 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-4b793254-0bed-4358-b2d0-b7d2ca4ec774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lazy-loading 'services' on Instance uuid fb553a5a-a341-4f34-9d09-4082d87fc076 {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:24:19.735167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4b793254-0bed-4358-b2d0-b7d2ca4ec774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-volume_attachments/76aafcd8-da6d-4b7a-9bd9-7c54a75ef28d" status: 202 len: 0 microversion: 2.1 time: 0.176175 Mar 30 07:24:19.735871 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 443/907] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:24:19 2022] DELETE /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-volume_attachments/76aafcd8-da6d-4b7a-9bd9-7c54a75ef28d => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:24:19.745364 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5925b085-5b81-4397-a152-6bb06e42379e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:19.746410 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5925b085-5b81-4397-a152-6bb06e42379e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:19.753404 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5925b085-5b81-4397-a152-6bb06e42379e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:19.753865 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5925b085-5b81-4397-a152-6bb06e42379e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:19.754686 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5925b085-5b81-4397-a152-6bb06e42379e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:19.755186 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5925b085-5b81-4397-a152-6bb06e42379e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:19.784005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5925b085-5b81-4397-a152-6bb06e42379e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 Mar 30 07:24:19.784610 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 465/908] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:24:19 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:20.797931 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-76d11ce8-3dac-49c3-b1e9-e1e068318fa7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:20.799274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-76d11ce8-3dac-49c3-b1e9-e1e068318fa7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:20.806711 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-76d11ce8-3dac-49c3-b1e9-e1e068318fa7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:20.807167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-76d11ce8-3dac-49c3-b1e9-e1e068318fa7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:20.807981 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-76d11ce8-3dac-49c3-b1e9-e1e068318fa7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:20.808401 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-76d11ce8-3dac-49c3-b1e9-e1e068318fa7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:20.844559 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-76d11ce8-3dac-49c3-b1e9-e1e068318fa7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051537 Mar 30 07:24:20.845045 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 444/909] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:24:20 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:24:20.920441 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0c3aa13e-6c5c-4e10-b0f4-96f20c7ed344 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:20.921429 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0c3aa13e-6c5c-4e10-b0f4-96f20c7ed344 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:20.931853 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0c3aa13e-6c5c-4e10-b0f4-96f20c7ed344 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:20.932402 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0c3aa13e-6c5c-4e10-b0f4-96f20c7ed344 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:20.933256 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0c3aa13e-6c5c-4e10-b0f4-96f20c7ed344 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:20.933631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0c3aa13e-6c5c-4e10-b0f4-96f20c7ed344 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:20.960073 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0c3aa13e-6c5c-4e10-b0f4-96f20c7ed344 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:24:21.060158 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0c3aa13e-6c5c-4e10-b0f4-96f20c7ed344 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 204 len: 0 microversion: 2.1 time: 0.145996 Mar 30 07:24:21.060872 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 466/910] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:24:20 2022] DELETE /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:24:21.069274 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e6a7b577-5679-4bf3-9117-f7a1183ae034 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:21.069882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e6a7b577-5679-4bf3-9117-f7a1183ae034 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:21.077182 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e6a7b577-5679-4bf3-9117-f7a1183ae034 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:21.077717 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e6a7b577-5679-4bf3-9117-f7a1183ae034 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:21.079002 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e6a7b577-5679-4bf3-9117-f7a1183ae034 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:21.079569 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e6a7b577-5679-4bf3-9117-f7a1183ae034 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:21.237510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e6a7b577-5679-4bf3-9117-f7a1183ae034 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:21.249771 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e6a7b577-5679-4bf3-9117-f7a1183ae034 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1681 microversion: 2.1 time: 0.184261 Mar 30 07:24:21.250551 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 445/911] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:21 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:22.276100 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-eaa7e9f2-29ea-4c8d-87cb-07117ab2c5d5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:22.276828 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-eaa7e9f2-29ea-4c8d-87cb-07117ab2c5d5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:22.284035 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eaa7e9f2-29ea-4c8d-87cb-07117ab2c5d5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:22.284542 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eaa7e9f2-29ea-4c8d-87cb-07117ab2c5d5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:22.285400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eaa7e9f2-29ea-4c8d-87cb-07117ab2c5d5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:22.285892 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eaa7e9f2-29ea-4c8d-87cb-07117ab2c5d5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:22.438595 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-eaa7e9f2-29ea-4c8d-87cb-07117ab2c5d5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:22.450473 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-eaa7e9f2-29ea-4c8d-87cb-07117ab2c5d5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1681 microversion: 2.1 time: 0.179588 Mar 30 07:24:22.451193 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 467/912] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:22 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:23.468382 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-70605a90-8a46-4694-9bff-4b7c71d0847f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:23.468943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-70605a90-8a46-4694-9bff-4b7c71d0847f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:23.476117 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-70605a90-8a46-4694-9bff-4b7c71d0847f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:23.476568 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-70605a90-8a46-4694-9bff-4b7c71d0847f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:23.477345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-70605a90-8a46-4694-9bff-4b7c71d0847f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:23.477813 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-70605a90-8a46-4694-9bff-4b7c71d0847f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:23.537020 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-70605a90-8a46-4694-9bff-4b7c71d0847f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:23.544967 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-70605a90-8a46-4694-9bff-4b7c71d0847f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 200 len: 1615 microversion: 2.1 time: 0.080714 Mar 30 07:24:23.545537 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 446/913] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:23 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 1615 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:23.674274 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-36cf7c9e-cad6-4857-ae3e-f87b88a12754 req-c25503cc-62cd-4d69-aac2-7efba5275283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb553a5a-a341-4f34-9d09-4082d87fc076", "name": "network-vif-deleted", "tag": "8f177682-1cd3-4432-bdc9-dd65cf3fa601"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:23.683586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-36cf7c9e-cad6-4857-ae3e-f87b88a12754 req-c25503cc-62cd-4d69-aac2-7efba5275283 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:23.684209 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-36cf7c9e-cad6-4857-ae3e-f87b88a12754 req-c25503cc-62cd-4d69-aac2-7efba5275283 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:23.699021 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-36cf7c9e-cad6-4857-ae3e-f87b88a12754 req-c25503cc-62cd-4d69-aac2-7efba5275283 service nova] Creating event network-vif-deleted:8f177682-1cd3-4432-bdc9-dd65cf3fa601 for instance fb553a5a-a341-4f34-9d09-4082d87fc076 on hv-cinder-83577 Mar 30 07:24:23.704819 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-36cf7c9e-cad6-4857-ae3e-f87b88a12754 req-c25503cc-62cd-4d69-aac2-7efba5275283 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034256 Mar 30 07:24:23.706081 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 468/914] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:24.562878 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:24.563495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:24.570452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:24.570913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:24.571720 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:24.572173 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:24.586618 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance fb553a5a-a341-4f34-9d09-4082d87fc076 could not be found. Mar 30 07:24:24.587302 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance fb553a5a-a341-4f34-9d09-4082d87fc076 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:24:24.588186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-bbc08871-f232-424d-b6b1-648916aa60e4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 404 len: 111 microversion: 2.1 time: 0.029366 Mar 30 07:24:24.588753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 447/915] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:24 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:24:24.597775 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ccc7b8d5-1224-41fb-a726-0f07911c4100 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '.version_select at 0x7f154d216670>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:24.620269 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ccc7b8d5-1224-41fb-a726-0f07911c4100 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482107491" status: 202 len: 0 microversion: 2.1 time: 0.026492 Mar 30 07:24:24.620866 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 469/916] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Mar 30 07:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482107491 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:24:25.250736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-31ec7a83-f674-4ad2-90ce-602e59833022 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: .version_select at 0x7f153ffb25e0>, body: {"keypair": {"name": "tempest-keypair-1281479323"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:25.265997 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-31ec7a83-f674-4ad2-90ce-602e59833022 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:24:25.270290 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-31ec7a83-f674-4ad2-90ce-602e59833022 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:24:25.465317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-31ec7a83-f674-4ad2-90ce-602e59833022 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:24:25.469133 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-31ec7a83-f674-4ad2-90ce-602e59833022 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:24:25.482908 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-31ec7a83-f674-4ad2-90ce-602e59833022 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.236153 Mar 30 07:24:25.483522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 448/917] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:24:25 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:26.812393 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1496016024", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73dd56e2-c247-440c-aa55-c3633a082de7"}], "security_groups": [{"name": "tempest-securitygroup--1422818952"}], "key_name": "tempest-keypair-1281479323", "user_data": "}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:26.927628 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.network.neutron [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] validate_networks() for [('73dd56e2-c247-440c-aa55-c3633a082de7', None, None, None, None, None)] {{(pid=117062) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:24:27.350326 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Flavor limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:24:27.351212 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Image limits 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:24:27.351866 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Flavor pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:24:27.352510 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Image pref 0:0:0 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:24:27.353105 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.virt.hardware [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:24:27.366741 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:27.367189 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:27.368809 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:27.369423 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:27.391240 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:24:27.395179 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'instances', 'ram', 'cores'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:24:27.406818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Going to run 1 instances... {{(pid=117062) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:24:27.409302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:24:27.461135 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1a42da06-dead-4ae2-a2ef-563eb292fc19 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.656514 Mar 30 07:24:27.461789 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 470/918] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:24:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:24:27.472342 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-838fe38c-94e4-43fb-83c6-1b98c90731c8 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:27.473095 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-838fe38c-94e4-43fb-83c6-1b98c90731c8 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:27.526504 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-838fe38c-94e4-43fb-83c6-1b98c90731c8 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:27.533918 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-838fe38c-94e4-43fb-83c6-1b98c90731c8 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1242 microversion: 2.1 time: 0.066091 Mar 30 07:24:27.534479 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 449/919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:27 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:28.552613 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-380795bd-0cac-460c-a58e-3a7cf2903422 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:28.553671 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-380795bd-0cac-460c-a58e-3a7cf2903422 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:28.562558 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-380795bd-0cac-460c-a58e-3a7cf2903422 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:28.563006 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-380795bd-0cac-460c-a58e-3a7cf2903422 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:28.563925 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-380795bd-0cac-460c-a58e-3a7cf2903422 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:28.564354 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-380795bd-0cac-460c-a58e-3a7cf2903422 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:28.630624 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-380795bd-0cac-460c-a58e-3a7cf2903422 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:28.638349 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-380795bd-0cac-460c-a58e-3a7cf2903422 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1312 microversion: 2.1 time: 0.090558 Mar 30 07:24:28.638914 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 471/920] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:28 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:29.656254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-31eaada9-0afd-404a-b6e8-c990dc996650 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:29.657871 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-31eaada9-0afd-404a-b6e8-c990dc996650 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:29.666076 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31eaada9-0afd-404a-b6e8-c990dc996650 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:29.666811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31eaada9-0afd-404a-b6e8-c990dc996650 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:29.668034 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31eaada9-0afd-404a-b6e8-c990dc996650 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:29.668728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-31eaada9-0afd-404a-b6e8-c990dc996650 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:29.816317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-31eaada9-0afd-404a-b6e8-c990dc996650 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:29.823945 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-31eaada9-0afd-404a-b6e8-c990dc996650 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1368 microversion: 2.1 time: 0.172246 Mar 30 07:24:29.824617 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 450/921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:29 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:29.855700 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-02b9b471-5a0a-41d0-97be-7469a498bded req-e307a1c5-5f3c-4d96-a854-d9dff450af44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d287ae8d-8382-4023-8788-f8789b1368d8", "tag": "d6bda4c0-cbe0-4984-9893-bf5ac3aa16bc"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:29.868886 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-02b9b471-5a0a-41d0-97be-7469a498bded req-e307a1c5-5f3c-4d96-a854-d9dff450af44 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:29.871537 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-02b9b471-5a0a-41d0-97be-7469a498bded req-e307a1c5-5f3c-4d96-a854-d9dff450af44 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:29.884168 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-02b9b471-5a0a-41d0-97be-7469a498bded req-e307a1c5-5f3c-4d96-a854-d9dff450af44 service nova] Creating event network-changed:d6bda4c0-cbe0-4984-9893-bf5ac3aa16bc for instance d287ae8d-8382-4023-8788-f8789b1368d8 on hv-cinder-83577 Mar 30 07:24:29.892973 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-02b9b471-5a0a-41d0-97be-7469a498bded req-e307a1c5-5f3c-4d96-a854-d9dff450af44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041739 Mar 30 07:24:29.894408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 472/922] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:30.841641 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5dc78263-42e4-49a5-8c18-62efbadc5335 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:30.842205 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5dc78263-42e4-49a5-8c18-62efbadc5335 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:30.848872 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5dc78263-42e4-49a5-8c18-62efbadc5335 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:30.849317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5dc78263-42e4-49a5-8c18-62efbadc5335 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:30.850197 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5dc78263-42e4-49a5-8c18-62efbadc5335 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:30.851125 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5dc78263-42e4-49a5-8c18-62efbadc5335 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:30.985657 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5dc78263-42e4-49a5-8c18-62efbadc5335 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:30.993291 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5dc78263-42e4-49a5-8c18-62efbadc5335 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1368 microversion: 2.1 time: 0.155558 Mar 30 07:24:30.993838 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 451/923] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:30 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:32.019109 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-b1cf7585-a0bc-429e-9950-5388c04108cf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:32.020306 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-b1cf7585-a0bc-429e-9950-5388c04108cf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:32.031035 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b1cf7585-a0bc-429e-9950-5388c04108cf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:32.031835 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b1cf7585-a0bc-429e-9950-5388c04108cf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:32.033107 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b1cf7585-a0bc-429e-9950-5388c04108cf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:32.033880 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-b1cf7585-a0bc-429e-9950-5388c04108cf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:32.179382 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-b1cf7585-a0bc-429e-9950-5388c04108cf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:32.191362 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-b1cf7585-a0bc-429e-9950-5388c04108cf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1368 microversion: 2.1 time: 0.179863 Mar 30 07:24:32.192328 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 473/924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:32 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:33.214113 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ba566139-8988-4b09-8e01-c281edd8494a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:33.214754 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ba566139-8988-4b09-8e01-c281edd8494a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:33.222901 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ba566139-8988-4b09-8e01-c281edd8494a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:33.223376 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ba566139-8988-4b09-8e01-c281edd8494a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:33.224230 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ba566139-8988-4b09-8e01-c281edd8494a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:33.224657 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ba566139-8988-4b09-8e01-c281edd8494a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:33.361616 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ba566139-8988-4b09-8e01-c281edd8494a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:33.370012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ba566139-8988-4b09-8e01-c281edd8494a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1368 microversion: 2.1 time: 0.159859 Mar 30 07:24:33.370581 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 452/925] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:33 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:34.386984 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-31d675c5-8aa3-4163-b8e3-f761f4ea0ca4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:34.387594 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-31d675c5-8aa3-4163-b8e3-f761f4ea0ca4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:34.394368 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-31d675c5-8aa3-4163-b8e3-f761f4ea0ca4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:34.394821 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-31d675c5-8aa3-4163-b8e3-f761f4ea0ca4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:34.395589 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-31d675c5-8aa3-4163-b8e3-f761f4ea0ca4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:34.396060 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-31d675c5-8aa3-4163-b8e3-f761f4ea0ca4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:34.536422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-31d675c5-8aa3-4163-b8e3-f761f4ea0ca4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:34.544075 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-31d675c5-8aa3-4163-b8e3-f761f4ea0ca4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1368 microversion: 2.1 time: 0.161026 Mar 30 07:24:34.544649 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 474/926] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:34 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:34.804429 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-5c6600ab-e429-4d55-8220-a95330874315 req-cc382f48-d048-44f8-ab1b-1da6efe3f0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d287ae8d-8382-4023-8788-f8789b1368d8", "name": "network-vif-plugged", "status": "completed", "tag": "d6bda4c0-cbe0-4984-9893-bf5ac3aa16bc"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:34.813382 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-5c6600ab-e429-4d55-8220-a95330874315 req-cc382f48-d048-44f8-ab1b-1da6efe3f0f2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:34.813830 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-5c6600ab-e429-4d55-8220-a95330874315 req-cc382f48-d048-44f8-ab1b-1da6efe3f0f2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:34.825505 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-5c6600ab-e429-4d55-8220-a95330874315 req-cc382f48-d048-44f8-ab1b-1da6efe3f0f2 service nova] Creating event network-vif-plugged:d6bda4c0-cbe0-4984-9893-bf5ac3aa16bc for instance d287ae8d-8382-4023-8788-f8789b1368d8 on hv-cinder-83577 Mar 30 07:24:34.830458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-5c6600ab-e429-4d55-8220-a95330874315 req-cc382f48-d048-44f8-ab1b-1da6efe3f0f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029898 Mar 30 07:24:34.831043 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 453/927] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:35.561341 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2aa3416f-a169-4b9d-8f8e-f89ce5ed6069 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:35.561977 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2aa3416f-a169-4b9d-8f8e-f89ce5ed6069 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:35.568716 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2aa3416f-a169-4b9d-8f8e-f89ce5ed6069 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:35.569200 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2aa3416f-a169-4b9d-8f8e-f89ce5ed6069 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:35.569975 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2aa3416f-a169-4b9d-8f8e-f89ce5ed6069 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:35.570470 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2aa3416f-a169-4b9d-8f8e-f89ce5ed6069 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:35.807844 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2aa3416f-a169-4b9d-8f8e-f89ce5ed6069 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:35.816204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2aa3416f-a169-4b9d-8f8e-f89ce5ed6069 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1368 microversion: 2.1 time: 0.258688 Mar 30 07:24:35.816793 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 475/928] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:35 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:36.838932 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-8acba5f2-b224-4599-8bca-5946d058c97f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:36.839687 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-8acba5f2-b224-4599-8bca-5946d058c97f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:36.846958 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8acba5f2-b224-4599-8bca-5946d058c97f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:36.847452 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8acba5f2-b224-4599-8bca-5946d058c97f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:36.848340 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8acba5f2-b224-4599-8bca-5946d058c97f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:36.848819 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-8acba5f2-b224-4599-8bca-5946d058c97f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:36.994395 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-8acba5f2-b224-4599-8bca-5946d058c97f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:37.006173 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-8acba5f2-b224-4599-8bca-5946d058c97f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1368 microversion: 2.1 time: 0.174225 Mar 30 07:24:37.006902 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 454/929] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:36 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:38.028026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-528a256d-65d8-4ab3-a1f1-d5c809aaa0cb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:38.028858 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-528a256d-65d8-4ab3-a1f1-d5c809aaa0cb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:38.037886 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-528a256d-65d8-4ab3-a1f1-d5c809aaa0cb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:38.038529 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-528a256d-65d8-4ab3-a1f1-d5c809aaa0cb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:38.039762 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-528a256d-65d8-4ab3-a1f1-d5c809aaa0cb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:38.040386 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-528a256d-65d8-4ab3-a1f1-d5c809aaa0cb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:38.452408 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-528a256d-65d8-4ab3-a1f1-d5c809aaa0cb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:38.463697 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-528a256d-65d8-4ab3-a1f1-d5c809aaa0cb tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1368 microversion: 2.1 time: 0.441792 Mar 30 07:24:38.464420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 476/930] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:38 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1368 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:38.889766 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0a767b00-a63e-442f-bb36-8e9a278d92b2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-992873962"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:38.890390 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0a767b00-a63e-442f-bb36-8e9a278d92b2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:38.896941 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0a767b00-a63e-442f-bb36-8e9a278d92b2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:38.897384 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0a767b00-a63e-442f-bb36-8e9a278d92b2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:38.898147 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0a767b00-a63e-442f-bb36-8e9a278d92b2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:38.898574 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0a767b00-a63e-442f-bb36-8e9a278d92b2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:39.039933 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.network.security_group_api [None req-0a767b00-a63e-442f-bb36-8e9a278d92b2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Removing security group bb1a96a7-a798-4b5e-9bc2-b6bedc0df24e from port 2248248f-9385-4ebf-85cd-c0c185df018b Mar 30 07:24:39.414935 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0a767b00-a63e-442f-bb36-8e9a278d92b2 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "POST /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/action" status: 202 len: 0 microversion: 2.1 time: 0.529040 Mar 30 07:24:39.415611 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 455/931] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Mar 30 07:24:38 2022] POST /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:24:39.425603 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-73c2cadb-1577-420c-9cd5-0ed0d74188e1 req-78f9ed20-e12d-4c4c-a2a2-009788c9777f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee340ba-0fee-4661-a390-d524855526cb", "tag": "2248248f-9385-4ebf-85cd-c0c185df018b"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:39.437658 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-73c2cadb-1577-420c-9cd5-0ed0d74188e1 req-78f9ed20-e12d-4c4c-a2a2-009788c9777f service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:39.438415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-73c2cadb-1577-420c-9cd5-0ed0d74188e1 req-78f9ed20-e12d-4c4c-a2a2-009788c9777f service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:39.467234 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-73c2cadb-1577-420c-9cd5-0ed0d74188e1 req-78f9ed20-e12d-4c4c-a2a2-009788c9777f service nova] Creating event network-changed:2248248f-9385-4ebf-85cd-c0c185df018b for instance aee340ba-0fee-4661-a390-d524855526cb on hv-cinder-83577 Mar 30 07:24:39.475327 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-73c2cadb-1577-420c-9cd5-0ed0d74188e1 req-78f9ed20-e12d-4c4c-a2a2-009788c9777f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052563 Mar 30 07:24:39.480562 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 477/932] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:39.487493 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-92342cc3-2dbf-429b-a6c0-8f6afb27b4a1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:39.488175 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-92342cc3-2dbf-429b-a6c0-8f6afb27b4a1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:39.497954 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-92342cc3-2dbf-429b-a6c0-8f6afb27b4a1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:39.498401 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-92342cc3-2dbf-429b-a6c0-8f6afb27b4a1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:39.499966 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-92342cc3-2dbf-429b-a6c0-8f6afb27b4a1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:39.500431 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-92342cc3-2dbf-429b-a6c0-8f6afb27b4a1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:39.843994 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-92342cc3-2dbf-429b-a6c0-8f6afb27b4a1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:39.851945 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-92342cc3-2dbf-429b-a6c0-8f6afb27b4a1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1558 microversion: 2.1 time: 0.369315 Mar 30 07:24:39.852855 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 456/933] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:39 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1558 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:39.870099 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c76bfeed-60f2-4f07-9149-94e98216dce1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:39.871190 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c76bfeed-60f2-4f07-9149-94e98216dce1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:39.877761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c76bfeed-60f2-4f07-9149-94e98216dce1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:39.880252 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c76bfeed-60f2-4f07-9149-94e98216dce1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:39.881231 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c76bfeed-60f2-4f07-9149-94e98216dce1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:39.881669 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c76bfeed-60f2-4f07-9149-94e98216dce1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:40.096679 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c76bfeed-60f2-4f07-9149-94e98216dce1 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231075 Mar 30 07:24:40.097381 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 478/934] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Mar 30 07:24:39 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:40.925587 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-a5a2ac43-d5d3-4f4b-9995-c31c4252e5dc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:40.926137 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-a5a2ac43-d5d3-4f4b-9995-c31c4252e5dc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:40.933160 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5a2ac43-d5d3-4f4b-9995-c31c4252e5dc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:40.933838 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5a2ac43-d5d3-4f4b-9995-c31c4252e5dc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:40.935287 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5a2ac43-d5d3-4f4b-9995-c31c4252e5dc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:40.935841 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-a5a2ac43-d5d3-4f4b-9995-c31c4252e5dc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:41.024265 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-a5a2ac43-d5d3-4f4b-9995-c31c4252e5dc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lazy-loading 'services' on Instance uuid aee340ba-0fee-4661-a390-d524855526cb {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:24:41.112068 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-a5a2ac43-d5d3-4f4b-9995-c31c4252e5dc tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments/6c022858-6d96-4985-8bf2-7332720e69da" status: 202 len: 0 microversion: 2.1 time: 0.190248 Mar 30 07:24:41.113130 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 457/935] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:24:40 2022] DELETE /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments/6c022858-6d96-4985-8bf2-7332720e69da => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:24:41.139228 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-33ef5d63-0abb-4652-a28c-8fcaf7ee247a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:41.149007 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-33ef5d63-0abb-4652-a28c-8fcaf7ee247a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:41.158853 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-33ef5d63-0abb-4652-a28c-8fcaf7ee247a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:41.159544 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-33ef5d63-0abb-4652-a28c-8fcaf7ee247a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:41.160263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-7624b6e8-2d41-4a91-8749-d6ae2550b232 req-308b3794-519c-47a9-934b-2d4a43f647a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d287ae8d-8382-4023-8788-f8789b1368d8", "tag": "d6bda4c0-cbe0-4984-9893-bf5ac3aa16bc"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:41.160721 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-33ef5d63-0abb-4652-a28c-8fcaf7ee247a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:41.161669 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-33ef5d63-0abb-4652-a28c-8fcaf7ee247a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:41.171597 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7624b6e8-2d41-4a91-8749-d6ae2550b232 req-308b3794-519c-47a9-934b-2d4a43f647a2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:41.172070 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-7624b6e8-2d41-4a91-8749-d6ae2550b232 req-308b3794-519c-47a9-934b-2d4a43f647a2 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:41.185656 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-7624b6e8-2d41-4a91-8749-d6ae2550b232 req-308b3794-519c-47a9-934b-2d4a43f647a2 service nova] Creating event network-changed:d6bda4c0-cbe0-4984-9893-bf5ac3aa16bc for instance d287ae8d-8382-4023-8788-f8789b1368d8 on hv-cinder-83577 Mar 30 07:24:41.190898 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-7624b6e8-2d41-4a91-8749-d6ae2550b232 req-308b3794-519c-47a9-934b-2d4a43f647a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040245 Mar 30 07:24:41.195028 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 458/936] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:41.199467 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-33ef5d63-0abb-4652-a28c-8fcaf7ee247a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082070 Mar 30 07:24:41.200405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 479/937] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:24:41 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:24:41.499335 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-97b78ed9-41e7-4918-9a60-34a3cdf5c2b9 req-d09a28ad-3333-46ab-98a5-b877ed3750f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee340ba-0fee-4661-a390-d524855526cb", "tag": "2248248f-9385-4ebf-85cd-c0c185df018b"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:41.508239 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-97b78ed9-41e7-4918-9a60-34a3cdf5c2b9 req-d09a28ad-3333-46ab-98a5-b877ed3750f5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:41.508991 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-97b78ed9-41e7-4918-9a60-34a3cdf5c2b9 req-d09a28ad-3333-46ab-98a5-b877ed3750f5 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:41.527573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-97b78ed9-41e7-4918-9a60-34a3cdf5c2b9 req-d09a28ad-3333-46ab-98a5-b877ed3750f5 service nova] Creating event network-changed:2248248f-9385-4ebf-85cd-c0c185df018b for instance aee340ba-0fee-4661-a390-d524855526cb on hv-cinder-83577 Mar 30 07:24:41.533205 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-97b78ed9-41e7-4918-9a60-34a3cdf5c2b9 req-d09a28ad-3333-46ab-98a5-b877ed3750f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038748 Mar 30 07:24:41.534202 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 459/938] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:42.210987 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-7a4e1271-9db7-44a0-9953-d225d256d697 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:42.212705 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-7a4e1271-9db7-44a0-9953-d225d256d697 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:42.220224 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7a4e1271-9db7-44a0-9953-d225d256d697 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:42.221114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7a4e1271-9db7-44a0-9953-d225d256d697 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:42.222199 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7a4e1271-9db7-44a0-9953-d225d256d697 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:42.222641 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-7a4e1271-9db7-44a0-9953-d225d256d697 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:42.257963 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-7a4e1271-9db7-44a0-9953-d225d256d697 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050773 Mar 30 07:24:42.258695 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 480/939] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:24:42 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:42.812180 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1329584910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1669774890", "security_groups": [{"name": "tempest-secgroup-smoke-1550549607"}], "block_device_mapping_v2": [{"uuid": "268da7bc-d832-41d2-bd3c-e022e3c4dac5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87604e57-b8c9-45c9-ab61-2b321b1caa0c"}]}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:42.929067 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] validate_networks() for [('87604e57-b8c9-45c9-ab61-2b321b1caa0c', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:24:43.272510 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f96e33dc-8704-465e-854d-249bc9a7ce83 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:43.275032 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f96e33dc-8704-465e-854d-249bc9a7ce83 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:43.282576 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f96e33dc-8704-465e-854d-249bc9a7ce83 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:43.283027 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f96e33dc-8704-465e-854d-249bc9a7ce83 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:43.283843 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f96e33dc-8704-465e-854d-249bc9a7ce83 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:43.284312 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f96e33dc-8704-465e-854d-249bc9a7ce83 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:43.311841 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f96e33dc-8704-465e-854d-249bc9a7ce83 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044813 Mar 30 07:24:43.312616 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 481/940] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:24:43 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:24:43.319373 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:24:43.319792 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:24:43.320292 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:24:43.320779 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:24:43.321186 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:24:43.322145 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:43.322639 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:43.328647 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:43.329096 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:43.329861 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:43.330290 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:43.331169 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:43.331715 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:43.332795 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:43.333231 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:43.352614 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for project 803772b9959c49c988cb738b94678917. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:24:43.357628 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Getting quotas for user 38e427dd29ea4380b01a1c257cc3da00 and project 803772b9959c49c988cb738b94678917. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:24:43.411024 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] HTTP exception thrown: Instance aee340ba-0fee-4661-a390-d524855526cb is not attached to volume 6c022858-6d96-4985-8bf2-7332720e69da Mar 30 07:24:43.411621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Returning 404 to user: Instance aee340ba-0fee-4661-a390-d524855526cb is not attached to volume 6c022858-6d96-4985-8bf2-7332720e69da {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:24:43.412492 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-6bb5d23c-fe58-48e6-aaee-3ec2ecbc4025 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments/6c022858-6d96-4985-8bf2-7332720e69da" status: 404 len: 154 microversion: 2.1 time: 0.094156 Mar 30 07:24:43.413051 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 482/941] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:24:43 2022] DELETE /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb/os-volume_attachments/6c022858-6d96-4985-8bf2-7332720e69da => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:24:43.424466 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:24:43.426306 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='268da7bc-d832-41d2-bd3c-e022e3c4dac5',volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:24:43.568332 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-87b32bbf-b64f-4def-83fa-8b916ba36156 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.876236 Mar 30 07:24:43.568887 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 460/942] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:24:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:24:43.579108 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-46ed30dd-caf8-479d-a369-c3aebee166b2 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:43.579722 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-46ed30dd-caf8-479d-a369-c3aebee166b2 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:43.635877 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-46ed30dd-caf8-479d-a369-c3aebee166b2 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:43.643789 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-46ed30dd-caf8-479d-a369-c3aebee166b2 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1095 microversion: 2.1 time: 0.068579 Mar 30 07:24:43.644394 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 483/943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:43 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:44.558600 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-18b05804-f02f-4feb-b127-19fce1e53278 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:44.559188 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-18b05804-f02f-4feb-b127-19fce1e53278 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:44.565780 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18b05804-f02f-4feb-b127-19fce1e53278 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:44.566227 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18b05804-f02f-4feb-b127-19fce1e53278 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:44.566993 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18b05804-f02f-4feb-b127-19fce1e53278 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:44.567597 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-18b05804-f02f-4feb-b127-19fce1e53278 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:44.597888 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-18b05804-f02f-4feb-b127-19fce1e53278 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:24:44.661552 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-67ab077c-5633-4a37-ba7a-be800f312109 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:44.662147 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-67ab077c-5633-4a37-ba7a-be800f312109 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:44.669472 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-67ab077c-5633-4a37-ba7a-be800f312109 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:44.670180 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-67ab077c-5633-4a37-ba7a-be800f312109 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:44.671473 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-67ab077c-5633-4a37-ba7a-be800f312109 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:44.672107 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-67ab077c-5633-4a37-ba7a-be800f312109 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:44.686924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-18b05804-f02f-4feb-b127-19fce1e53278 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 204 len: 0 microversion: 2.1 time: 0.132071 Mar 30 07:24:44.691428 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 461/944] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:24:44 2022] DELETE /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:24:44.696596 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-2e72ee5f-7e29-457e-9840-7a1397600a50 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:44.697289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-2e72ee5f-7e29-457e-9840-7a1397600a50 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:44.703863 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2e72ee5f-7e29-457e-9840-7a1397600a50 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:44.708128 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2e72ee5f-7e29-457e-9840-7a1397600a50 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:44.708973 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2e72ee5f-7e29-457e-9840-7a1397600a50 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:44.709416 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-2e72ee5f-7e29-457e-9840-7a1397600a50 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:44.737394 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-67ab077c-5633-4a37-ba7a-be800f312109 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:44.744794 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-67ab077c-5633-4a37-ba7a-be800f312109 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1211 microversion: 2.1 time: 0.087903 Mar 30 07:24:44.745358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 484/945] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:44 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:24:44.855699 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-2e72ee5f-7e29-457e-9840-7a1397600a50 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:44.863266 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-2e72ee5f-7e29-457e-9840-7a1397600a50 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1554 microversion: 2.1 time: 0.171017 Mar 30 07:24:44.863865 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 462/946] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:44 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:24:45.763409 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-34d1eb86-91a6-4489-8a8a-1bd0a0d2dc40 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:45.764038 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-34d1eb86-91a6-4489-8a8a-1bd0a0d2dc40 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:45.772772 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-34d1eb86-91a6-4489-8a8a-1bd0a0d2dc40 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:45.773230 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-34d1eb86-91a6-4489-8a8a-1bd0a0d2dc40 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:45.774043 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-34d1eb86-91a6-4489-8a8a-1bd0a0d2dc40 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:45.774439 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-34d1eb86-91a6-4489-8a8a-1bd0a0d2dc40 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:45.881267 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-5299d541-8835-4c4a-929b-78aa50710036 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:45.882211 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-5299d541-8835-4c4a-929b-78aa50710036 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:45.891510 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5299d541-8835-4c4a-929b-78aa50710036 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:45.892337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5299d541-8835-4c4a-929b-78aa50710036 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:45.893866 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5299d541-8835-4c4a-929b-78aa50710036 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:45.894469 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-5299d541-8835-4c4a-929b-78aa50710036 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:45.925005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-34d1eb86-91a6-4489-8a8a-1bd0a0d2dc40 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:45.933108 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-34d1eb86-91a6-4489-8a8a-1bd0a0d2dc40 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.174661 Mar 30 07:24:45.934592 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 485/947] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:45 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:46.050162 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-5299d541-8835-4c4a-929b-78aa50710036 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:46.061878 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-7e7fe425-129a-432e-824a-b9d483f13fe8 req-ea72dceb-d449-485c-91fe-f2c409e94819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb5355d-cff6-45b6-a2f6-4527a3c77467", "tag": "7a189a71-9b20-445d-864b-af349fb8f6a9"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:46.065522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-5299d541-8835-4c4a-929b-78aa50710036 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1554 microversion: 2.1 time: 0.180876 Mar 30 07:24:46.067253 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 463/948] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:45 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:24:46.071764 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-7e7fe425-129a-432e-824a-b9d483f13fe8 req-ea72dceb-d449-485c-91fe-f2c409e94819 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:46.072235 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-7e7fe425-129a-432e-824a-b9d483f13fe8 req-ea72dceb-d449-485c-91fe-f2c409e94819 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:46.092389 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-7e7fe425-129a-432e-824a-b9d483f13fe8 req-ea72dceb-d449-485c-91fe-f2c409e94819 service nova] Creating event network-changed:7a189a71-9b20-445d-864b-af349fb8f6a9 for instance 6bb5355d-cff6-45b6-a2f6-4527a3c77467 on hv-cinder-83577 Mar 30 07:24:46.110620 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-7e7fe425-129a-432e-824a-b9d483f13fe8 req-ea72dceb-d449-485c-91fe-f2c409e94819 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052869 Mar 30 07:24:46.111251 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 486/949] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:24:46.950662 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0a99f93a-9118-4b53-81a6-f954bcc80c01 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:46.951288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0a99f93a-9118-4b53-81a6-f954bcc80c01 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:46.958015 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0a99f93a-9118-4b53-81a6-f954bcc80c01 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:46.958470 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0a99f93a-9118-4b53-81a6-f954bcc80c01 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:46.959245 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0a99f93a-9118-4b53-81a6-f954bcc80c01 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:46.960328 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0a99f93a-9118-4b53-81a6-f954bcc80c01 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:47.084962 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1a580add-c40b-4c67-8e22-2c9bd4ab5e55 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:47.086616 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1a580add-c40b-4c67-8e22-2c9bd4ab5e55 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:47.095711 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1a580add-c40b-4c67-8e22-2c9bd4ab5e55 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:47.096440 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1a580add-c40b-4c67-8e22-2c9bd4ab5e55 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:47.097189 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1a580add-c40b-4c67-8e22-2c9bd4ab5e55 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:47.097622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1a580add-c40b-4c67-8e22-2c9bd4ab5e55 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:47.223205 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-0a99f93a-9118-4b53-81a6-f954bcc80c01 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:47.231997 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0a99f93a-9118-4b53-81a6-f954bcc80c01 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.285175 Mar 30 07:24:47.238178 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 464/950] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:46 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:47.339382 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1a580add-c40b-4c67-8e22-2c9bd4ab5e55 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52cc2951a1c4a11a369acd769c78db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:47.346929 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1a580add-c40b-4c67-8e22-2c9bd4ab5e55 tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 200 len: 1554 microversion: 2.1 time: 0.266753 Mar 30 07:24:47.347599 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 487/951] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:47 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 1554 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:24:47.695520 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-11d8b759-5f97-45cf-88df-4ec6c0dc14b6 req-55c76268-8be1-4f44-ad37-02e057d2c414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee340ba-0fee-4661-a390-d524855526cb", "name": "network-vif-deleted", "tag": "2248248f-9385-4ebf-85cd-c0c185df018b"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:47.703666 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-11d8b759-5f97-45cf-88df-4ec6c0dc14b6 req-55c76268-8be1-4f44-ad37-02e057d2c414 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:47.704132 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-11d8b759-5f97-45cf-88df-4ec6c0dc14b6 req-55c76268-8be1-4f44-ad37-02e057d2c414 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:47.714831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-11d8b759-5f97-45cf-88df-4ec6c0dc14b6 req-55c76268-8be1-4f44-ad37-02e057d2c414 service nova] Creating event network-vif-deleted:2248248f-9385-4ebf-85cd-c0c185df018b for instance aee340ba-0fee-4661-a390-d524855526cb on hv-cinder-83577 Mar 30 07:24:47.727626 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-11d8b759-5f97-45cf-88df-4ec6c0dc14b6 req-55c76268-8be1-4f44-ad37-02e057d2c414 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035831 Mar 30 07:24:47.728270 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 465/952] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:48.249132 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-69d91774-cfae-4d2d-b165-fc4b7f7a6707 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:48.249791 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-69d91774-cfae-4d2d-b165-fc4b7f7a6707 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:48.256512 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-69d91774-cfae-4d2d-b165-fc4b7f7a6707 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:48.256953 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-69d91774-cfae-4d2d-b165-fc4b7f7a6707 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:48.257730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-69d91774-cfae-4d2d-b165-fc4b7f7a6707 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:48.258199 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-69d91774-cfae-4d2d-b165-fc4b7f7a6707 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:48.365741 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:48.366559 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] [instance: aee340ba-0fee-4661-a390-d524855526cb] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:48.373250 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:48.373691 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:48.374461 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:48.374884 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:48.388352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] HTTP exception thrown: Instance aee340ba-0fee-4661-a390-d524855526cb could not be found. Mar 30 07:24:48.388935 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Returning 404 to user: Instance aee340ba-0fee-4661-a390-d524855526cb could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:24:48.389787 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d62f7e36-d785-40ad-b7bb-5bcc9124921a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb" status: 404 len: 111 microversion: 2.1 time: 0.028764 Mar 30 07:24:48.390304 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 466/953] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:48 2022] GET /compute/v2.1/servers/aee340ba-0fee-4661-a390-d524855526cb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:24:48.398597 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ce71b2dd-8f62-4849-b1a8-7d4eb772775a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] Calling method '.version_select at 0x7f153ff0d0d0>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:48.409818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-69d91774-cfae-4d2d-b165-fc4b7f7a6707 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:48.417292 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ce71b2dd-8f62-4849-b1a8-7d4eb772775a tempest-TestMinimumBasicScenario-1506873784 tempest-TestMinimumBasicScenario-1506873784-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1446907644" status: 202 len: 0 microversion: 2.1 time: 0.022236 Mar 30 07:24:48.417866 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 467/954] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Mar 30 07:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1446907644 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 30 07:24:48.419249 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-69d91774-cfae-4d2d-b165-fc4b7f7a6707 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.174114 Mar 30 07:24:48.420033 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 488/955] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:48 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:49.436975 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9813a25d-f93c-4618-975d-124a70370e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:49.437596 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9813a25d-f93c-4618-975d-124a70370e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:49.444337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9813a25d-f93c-4618-975d-124a70370e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:49.444793 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9813a25d-f93c-4618-975d-124a70370e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:49.445573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9813a25d-f93c-4618-975d-124a70370e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:49.446008 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9813a25d-f93c-4618-975d-124a70370e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:49.692804 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9813a25d-f93c-4618-975d-124a70370e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:49.700693 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9813a25d-f93c-4618-975d-124a70370e27 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.268484 Mar 30 07:24:49.701265 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 468/956] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:49 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:50.719460 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-cb954e79-771e-4bcd-84eb-f8f5a1786032 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:50.721251 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-cb954e79-771e-4bcd-84eb-f8f5a1786032 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:50.734064 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb954e79-771e-4bcd-84eb-f8f5a1786032 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:50.735670 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb954e79-771e-4bcd-84eb-f8f5a1786032 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:50.736978 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb954e79-771e-4bcd-84eb-f8f5a1786032 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:50.737629 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-cb954e79-771e-4bcd-84eb-f8f5a1786032 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:50.962877 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-cb954e79-771e-4bcd-84eb-f8f5a1786032 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:50.971980 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-cb954e79-771e-4bcd-84eb-f8f5a1786032 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.257295 Mar 30 07:24:50.981208 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 489/957] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:50 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:51.989188 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ceabe520-5a00-4878-8e65-ee2820fce22b tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:51.989923 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ceabe520-5a00-4878-8e65-ee2820fce22b tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:51.996947 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ceabe520-5a00-4878-8e65-ee2820fce22b tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:51.997522 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ceabe520-5a00-4878-8e65-ee2820fce22b tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:51.998610 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ceabe520-5a00-4878-8e65-ee2820fce22b tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:51.999144 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ceabe520-5a00-4878-8e65-ee2820fce22b tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:52.246741 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-ceabe520-5a00-4878-8e65-ee2820fce22b tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:52.254786 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ceabe520-5a00-4878-8e65-ee2820fce22b tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.269634 Mar 30 07:24:52.255460 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 469/958] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:51 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:53.271989 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-42b74fcd-9b37-4e0b-9a46-f1ea23c90367 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:53.272579 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-42b74fcd-9b37-4e0b-9a46-f1ea23c90367 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:53.279439 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-42b74fcd-9b37-4e0b-9a46-f1ea23c90367 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:53.279831 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-42b74fcd-9b37-4e0b-9a46-f1ea23c90367 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:53.280632 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-42b74fcd-9b37-4e0b-9a46-f1ea23c90367 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:53.281030 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-42b74fcd-9b37-4e0b-9a46-f1ea23c90367 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:53.417489 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-42b74fcd-9b37-4e0b-9a46-f1ea23c90367 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:53.425681 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-42b74fcd-9b37-4e0b-9a46-f1ea23c90367 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.157616 Mar 30 07:24:53.426267 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 490/959] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:53 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:54.442887 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c49e4b98-fef7-464d-9567-127e1f4dbcdc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:54.443846 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c49e4b98-fef7-464d-9567-127e1f4dbcdc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:54.450713 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c49e4b98-fef7-464d-9567-127e1f4dbcdc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:54.451189 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c49e4b98-fef7-464d-9567-127e1f4dbcdc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:54.452240 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c49e4b98-fef7-464d-9567-127e1f4dbcdc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:54.452855 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c49e4b98-fef7-464d-9567-127e1f4dbcdc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:54.719407 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-c49e4b98-fef7-464d-9567-127e1f4dbcdc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:54.728912 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c49e4b98-fef7-464d-9567-127e1f4dbcdc tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.289974 Mar 30 07:24:54.729668 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 470/960] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:54 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:55.748346 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1c5a4212-4db1-4144-a1b1-2e94fe9b8fb9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:55.749081 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1c5a4212-4db1-4144-a1b1-2e94fe9b8fb9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:55.757916 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1c5a4212-4db1-4144-a1b1-2e94fe9b8fb9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:55.758471 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1c5a4212-4db1-4144-a1b1-2e94fe9b8fb9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:55.759355 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1c5a4212-4db1-4144-a1b1-2e94fe9b8fb9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:55.759925 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1c5a4212-4db1-4144-a1b1-2e94fe9b8fb9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:55.933870 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-1c5a4212-4db1-4144-a1b1-2e94fe9b8fb9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:55.941663 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1c5a4212-4db1-4144-a1b1-2e94fe9b8fb9 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.198883 Mar 30 07:24:55.942240 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 491/961] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:55 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:56.926442 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-88cc12fc-dd89-418a-b510-2ddf5245c10e req-11259397-f439-4570-9d31-f1d3307c5b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb5355d-cff6-45b6-a2f6-4527a3c77467", "name": "network-vif-plugged", "status": "completed", "tag": "7a189a71-9b20-445d-864b-af349fb8f6a9"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:24:56.936379 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-88cc12fc-dd89-418a-b510-2ddf5245c10e req-11259397-f439-4570-9d31-f1d3307c5b30 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:56.936775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-88cc12fc-dd89-418a-b510-2ddf5245c10e req-11259397-f439-4570-9d31-f1d3307c5b30 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:56.949748 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-88cc12fc-dd89-418a-b510-2ddf5245c10e req-11259397-f439-4570-9d31-f1d3307c5b30 service nova] Creating event network-vif-plugged:7a189a71-9b20-445d-864b-af349fb8f6a9 for instance 6bb5355d-cff6-45b6-a2f6-4527a3c77467 on hv-cinder-83577 Mar 30 07:24:56.955391 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-88cc12fc-dd89-418a-b510-2ddf5245c10e req-11259397-f439-4570-9d31-f1d3307c5b30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 Mar 30 07:24:56.956278 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 471/962] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:24:56.959875 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-662cf1f8-8800-4d31-b267-b71818dbc769 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:56.960590 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-662cf1f8-8800-4d31-b267-b71818dbc769 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:56.968358 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-662cf1f8-8800-4d31-b267-b71818dbc769 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:56.969274 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-662cf1f8-8800-4d31-b267-b71818dbc769 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:56.970165 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-662cf1f8-8800-4d31-b267-b71818dbc769 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:56.970692 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-662cf1f8-8800-4d31-b267-b71818dbc769 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:57.151588 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-662cf1f8-8800-4d31-b267-b71818dbc769 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:57.159114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-662cf1f8-8800-4d31-b267-b71818dbc769 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.204305 Mar 30 07:24:57.159697 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 492/963] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:56 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:58.181773 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-bbcb9a9b-29c2-41f3-ae10-65db5b3e773a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:58.182907 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-bbcb9a9b-29c2-41f3-ae10-65db5b3e773a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:58.192359 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bbcb9a9b-29c2-41f3-ae10-65db5b3e773a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:58.192810 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bbcb9a9b-29c2-41f3-ae10-65db5b3e773a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:58.193584 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bbcb9a9b-29c2-41f3-ae10-65db5b3e773a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:58.194016 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-bbcb9a9b-29c2-41f3-ae10-65db5b3e773a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:58.338990 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-bbcb9a9b-29c2-41f3-ae10-65db5b3e773a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:58.346788 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-bbcb9a9b-29c2-41f3-ae10-65db5b3e773a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1267 microversion: 2.1 time: 0.172880 Mar 30 07:24:58.347357 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 472/964] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:58 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:59.369621 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-eaa0e60a-2895-47c5-8e1e-9b136f134ff5 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:59.370609 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-eaa0e60a-2895-47c5-8e1e-9b136f134ff5 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:59.382243 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eaa0e60a-2895-47c5-8e1e-9b136f134ff5 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:59.382888 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eaa0e60a-2895-47c5-8e1e-9b136f134ff5 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:59.384605 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eaa0e60a-2895-47c5-8e1e-9b136f134ff5 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:59.385752 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-eaa0e60a-2895-47c5-8e1e-9b136f134ff5 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:59.802163 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-eaa0e60a-2895-47c5-8e1e-9b136f134ff5 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:59.812995 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-eaa0e60a-2895-47c5-8e1e-9b136f134ff5 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1454 microversion: 2.1 time: 0.449944 Mar 30 07:24:59.813584 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 493/965] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:59 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1454 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:24:59.829829 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9b493ad2-68a7-46de-aae5-a0d690d87ab6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:24:59.830473 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9b493ad2-68a7-46de-aae5-a0d690d87ab6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:24:59.837096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9b493ad2-68a7-46de-aae5-a0d690d87ab6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:59.837537 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9b493ad2-68a7-46de-aae5-a0d690d87ab6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:59.838289 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9b493ad2-68a7-46de-aae5-a0d690d87ab6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:24:59.838750 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9b493ad2-68a7-46de-aae5-a0d690d87ab6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:24:59.983443 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-9b493ad2-68a7-46de-aae5-a0d690d87ab6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:24:59.991393 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9b493ad2-68a7-46de-aae5-a0d690d87ab6 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1454 microversion: 2.1 time: 0.165472 Mar 30 07:24:59.991978 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 473/966] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:24:59 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:01.683631 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-fe7f8364-83d3-4dfd-ba8c-96d9f3759f83 req-32826900-a8a7-47fe-b98f-ccadd7048fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb5355d-cff6-45b6-a2f6-4527a3c77467", "tag": "7a189a71-9b20-445d-864b-af349fb8f6a9"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:01.692547 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-fe7f8364-83d3-4dfd-ba8c-96d9f3759f83 req-32826900-a8a7-47fe-b98f-ccadd7048fee service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:01.692972 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-fe7f8364-83d3-4dfd-ba8c-96d9f3759f83 req-32826900-a8a7-47fe-b98f-ccadd7048fee service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:01.704545 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-fe7f8364-83d3-4dfd-ba8c-96d9f3759f83 req-32826900-a8a7-47fe-b98f-ccadd7048fee service nova] Creating event network-changed:7a189a71-9b20-445d-864b-af349fb8f6a9 for instance 6bb5355d-cff6-45b6-a2f6-4527a3c77467 on hv-cinder-83577 Mar 30 07:25:01.709586 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-fe7f8364-83d3-4dfd-ba8c-96d9f3759f83 req-32826900-a8a7-47fe-b98f-ccadd7048fee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029632 Mar 30 07:25:01.710293 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 494/967] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:25:17.502416 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1ec29fb2-d9d8-4fb2-a1ca-e148cd271af4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:17.502911 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1ec29fb2-d9d8-4fb2-a1ca-e148cd271af4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:17.512313 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1ec29fb2-d9d8-4fb2-a1ca-e148cd271af4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:17.512858 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1ec29fb2-d9d8-4fb2-a1ca-e148cd271af4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:17.514000 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1ec29fb2-d9d8-4fb2-a1ca-e148cd271af4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:17.514633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1ec29fb2-d9d8-4fb2-a1ca-e148cd271af4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:17.537784 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1ec29fb2-d9d8-4fb2-a1ca-e148cd271af4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/ips" status: 200 len: 149 microversion: 2.1 time: 0.042287 Mar 30 07:25:17.538337 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 474/968] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:25:17 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:25:18.874427 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a5702a31-2881-41ba-a891-ae315fb3af2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88ca58ed-1fad-474f-9f26-19a2008229e3"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:18.875576 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a5702a31-2881-41ba-a891-ae315fb3af2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:18.884320 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a5702a31-2881-41ba-a891-ae315fb3af2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:18.884933 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a5702a31-2881-41ba-a891-ae315fb3af2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:18.886010 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a5702a31-2881-41ba-a891-ae315fb3af2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:18.886574 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a5702a31-2881-41ba-a891-ae315fb3af2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:19.187149 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a5702a31-2881-41ba-a891-ae315fb3af2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316946 Mar 30 07:25:19.187779 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 495/969] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:25:18 2022] POST /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:25:26.762451 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88ca58ed-1fad-474f-9f26-19a2008229e3"}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:26.763874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:26.773385 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:26.773837 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:26.774605 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:26.775042 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:26.862302 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Invalid volume: volume 88ca58ed-1fad-474f-9f26-19a2008229e3 is already attached to instances: d287ae8d-8382-4023-8788-f8789b1368d8 Mar 30 07:25:26.863031 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 400 to user: Invalid volume: volume 88ca58ed-1fad-474f-9f26-19a2008229e3 is already attached to instances: d287ae8d-8382-4023-8788-f8789b1368d8 {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:25:26.864362 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-09c1b3ec-ff4b-4603-a8d4-9edfb243a286 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108345 Mar 30 07:25:26.865133 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 475/970] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:25:26 2022] POST /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 30 07:25:26.926083 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1fbd4495-f307-4df4-9be6-6deea807408f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:26.926622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1fbd4495-f307-4df4-9be6-6deea807408f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:26.933167 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1fbd4495-f307-4df4-9be6-6deea807408f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:26.933620 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1fbd4495-f307-4df4-9be6-6deea807408f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:26.934399 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1fbd4495-f307-4df4-9be6-6deea807408f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:26.934832 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1fbd4495-f307-4df4-9be6-6deea807408f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:27.020904 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-1fbd4495-f307-4df4-9be6-6deea807408f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lazy-loading 'services' on Instance uuid d287ae8d-8382-4023-8788-f8789b1368d8 {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:25:27.096302 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1fbd4495-f307-4df4-9be6-6deea807408f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments/88ca58ed-1fad-474f-9f26-19a2008229e3" status: 202 len: 0 microversion: 2.1 time: 0.174820 Mar 30 07:25:27.097234 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 496/971] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:25:26 2022] DELETE /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments/88ca58ed-1fad-474f-9f26-19a2008229e3 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:25:27.109976 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-ffcb4b75-455a-4dfd-8dee-41af512613b4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:27.111013 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-ffcb4b75-455a-4dfd-8dee-41af512613b4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:27.117930 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ffcb4b75-455a-4dfd-8dee-41af512613b4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:27.118633 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ffcb4b75-455a-4dfd-8dee-41af512613b4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:27.119415 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ffcb4b75-455a-4dfd-8dee-41af512613b4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:27.120105 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-ffcb4b75-455a-4dfd-8dee-41af512613b4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:27.151704 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-ffcb4b75-455a-4dfd-8dee-41af512613b4 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048344 Mar 30 07:25:27.152300 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 476/972] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:25:27 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:25:28.167457 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f610fffa-209d-4893-a14e-b15f73c47862 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:28.169096 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f610fffa-209d-4893-a14e-b15f73c47862 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:28.180717 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f610fffa-209d-4893-a14e-b15f73c47862 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:28.181458 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f610fffa-209d-4893-a14e-b15f73c47862 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:28.182722 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f610fffa-209d-4893-a14e-b15f73c47862 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:28.183454 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f610fffa-209d-4893-a14e-b15f73c47862 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:28.215444 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f610fffa-209d-4893-a14e-b15f73c47862 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055441 Mar 30 07:25:28.216042 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 497/973] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:25:28 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:25:28.276995 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7d1a0ee3-9333-464b-ab0f-cae1744b0b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:28.277777 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7d1a0ee3-9333-464b-ab0f-cae1744b0b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:28.285872 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7d1a0ee3-9333-464b-ab0f-cae1744b0b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:28.286354 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7d1a0ee3-9333-464b-ab0f-cae1744b0b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:28.287114 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7d1a0ee3-9333-464b-ab0f-cae1744b0b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:28.287542 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7d1a0ee3-9333-464b-ab0f-cae1744b0b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:28.311463 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7d1a0ee3-9333-464b-ab0f-cae1744b0b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:25:28.399649 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7d1a0ee3-9333-464b-ab0f-cae1744b0b57 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 204 len: 0 microversion: 2.1 time: 0.128654 Mar 30 07:25:28.400696 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 477/974] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:25:28 2022] DELETE /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:25:28.409202 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-39947df5-2e02-4841-9c20-f2226ea5028e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:28.409909 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-39947df5-2e02-4841-9c20-f2226ea5028e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:28.415964 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-39947df5-2e02-4841-9c20-f2226ea5028e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:28.416422 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-39947df5-2e02-4841-9c20-f2226ea5028e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:28.417190 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-39947df5-2e02-4841-9c20-f2226ea5028e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:28.417681 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-39947df5-2e02-4841-9c20-f2226ea5028e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:28.563604 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-39947df5-2e02-4841-9c20-f2226ea5028e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:28.574866 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-39947df5-2e02-4841-9c20-f2226ea5028e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1682 microversion: 2.1 time: 0.169702 Mar 30 07:25:28.575601 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 498/975] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:28 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:25:29.598928 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-80396455-6d1e-4960-8804-21bf37f1389e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:29.600137 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-80396455-6d1e-4960-8804-21bf37f1389e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:29.611323 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-80396455-6d1e-4960-8804-21bf37f1389e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:29.612148 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-80396455-6d1e-4960-8804-21bf37f1389e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:29.613414 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-80396455-6d1e-4960-8804-21bf37f1389e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:29.614139 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-80396455-6d1e-4960-8804-21bf37f1389e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:29.764667 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-80396455-6d1e-4960-8804-21bf37f1389e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:29.772752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-80396455-6d1e-4960-8804-21bf37f1389e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1682 microversion: 2.1 time: 0.180993 Mar 30 07:25:29.773328 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 478/976] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:29 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:30.794770 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3cabc2c2-53e2-4c03-bb83-fd0bbdd0721d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:30.795306 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3cabc2c2-53e2-4c03-bb83-fd0bbdd0721d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:30.802839 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3cabc2c2-53e2-4c03-bb83-fd0bbdd0721d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:30.803301 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3cabc2c2-53e2-4c03-bb83-fd0bbdd0721d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:30.804097 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3cabc2c2-53e2-4c03-bb83-fd0bbdd0721d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:30.804526 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3cabc2c2-53e2-4c03-bb83-fd0bbdd0721d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:30.928527 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3cabc2c2-53e2-4c03-bb83-fd0bbdd0721d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:30.936979 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3cabc2c2-53e2-4c03-bb83-fd0bbdd0721d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 200 len: 1614 microversion: 2.1 time: 0.146801 Mar 30 07:25:30.937525 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 499/977] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:30 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 1614 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:31.026490 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-5efdde1c-c332-4fbd-b47c-c3d4c5c3920b req-415edc52-13a1-4ead-b178-328aee925bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d287ae8d-8382-4023-8788-f8789b1368d8", "name": "network-vif-deleted", "tag": "d6bda4c0-cbe0-4984-9893-bf5ac3aa16bc"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:31.040494 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-5efdde1c-c332-4fbd-b47c-c3d4c5c3920b req-415edc52-13a1-4ead-b178-328aee925bbc service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:31.041168 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-5efdde1c-c332-4fbd-b47c-c3d4c5c3920b req-415edc52-13a1-4ead-b178-328aee925bbc service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:31.062317 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-5efdde1c-c332-4fbd-b47c-c3d4c5c3920b req-415edc52-13a1-4ead-b178-328aee925bbc service nova] Creating event network-vif-deleted:d6bda4c0-cbe0-4984-9893-bf5ac3aa16bc for instance d287ae8d-8382-4023-8788-f8789b1368d8 on hv-cinder-83577 Mar 30 07:25:31.067796 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-5efdde1c-c332-4fbd-b47c-c3d4c5c3920b req-415edc52-13a1-4ead-b178-328aee925bbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045202 Mar 30 07:25:31.068728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 479/978] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:25:31.955504 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:31.958564 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:31.966818 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:31.967394 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:31.968207 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:31.968735 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:31.988597 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance d287ae8d-8382-4023-8788-f8789b1368d8 could not be found. Mar 30 07:25:31.989227 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance d287ae8d-8382-4023-8788-f8789b1368d8 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:25:31.992521 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1e65a509-3e7b-45a7-bbd4-c783bf288385 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 404 len: 111 microversion: 2.1 time: 0.041593 Mar 30 07:25:31.993525 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 500/979] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:31 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:25:32.002629 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-29dadc58-23d0-44d7-997b-2df308e9d63f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '.version_select at 0x7f153ff29e50>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:32.021804 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-29dadc58-23d0-44d7-997b-2df308e9d63f tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281479323" status: 202 len: 0 microversion: 2.1 time: 0.023590 Mar 30 07:25:32.022383 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 480/980] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Mar 30 07:25:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281479323 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:25:32.941396 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-620fc978-669a-45d9-b090-e6778b46a678 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: .version_select at 0x7f154c5baee0>, body: {"keypair": {"name": "tempest-keypair-2111086980"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:32.960708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-620fc978-669a-45d9-b090-e6778b46a678 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:25:32.965085 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-620fc978-669a-45d9-b090-e6778b46a678 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:25:33.069555 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-620fc978-669a-45d9-b090-e6778b46a678 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:25:33.073320 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.quota [None req-620fc978-669a-45d9-b090-e6778b46a678 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'key_pairs'} {{(pid=117062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:25:33.086655 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-620fc978-669a-45d9-b090-e6778b46a678 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.150823 Mar 30 07:25:33.087186 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 501/981] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Mar 30 07:25:32 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:34.410732 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1174344911", "imageRef": "143c48a1-022d-491a-a082-d32f6be037bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73dd56e2-c247-440c-aa55-c3633a082de7"}], "security_groups": [{"name": "tempest-securitygroup--1763072996"}], "key_name": "tempest-keypair-2111086980", "user_data": "}} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:34.679223 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.network.neutron [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] validate_networks() for [('73dd56e2-c247-440c-aa55-c3633a082de7', None, None, None, None, None)] {{(pid=117063) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 30 07:25:35.091845 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Flavor limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 30 07:25:35.092455 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Image limits 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 30 07:25:35.093171 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Flavor pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 30 07:25:35.093802 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Image pref 0:0:0 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 30 07:25:35.094397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.virt.hardware [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 30 07:25:35.107879 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:35.108471 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:35.109679 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:35.110269 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:35.128096 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 30 07:25:35.132550 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.quota [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Getting quotas for user b0a49ff45f0e43958ceeffd704999f00 and project 2482f983870c40ad8fe2e8a9ae69169c. Resources: {'instances', 'ram', 'cores'} {{(pid=117063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 30 07:25:35.144969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Going to run 1 instances... {{(pid=117063) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 30 07:25:35.147370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='143c48a1-022d-491a-a082-d32f6be037bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 30 07:25:35.195652 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-d5f53efb-e9ce-4283-b68b-6484397b41b3 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.789747 Mar 30 07:25:35.196332 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 481/982] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Mar 30 07:25:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 30 07:25:35.207102 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d74c3591-035c-4686-8afe-ed1180c0a67e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:35.207696 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d74c3591-035c-4686-8afe-ed1180c0a67e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:35.362922 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-d74c3591-035c-4686-8afe-ed1180c0a67e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:35.370308 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d74c3591-035c-4686-8afe-ed1180c0a67e tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1242 microversion: 2.1 time: 0.167538 Mar 30 07:25:35.371249 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 502/983] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:35 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1242 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 30 07:25:36.388681 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-e24772f6-fa98-4ceb-8953-fc5cc69e41f7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:36.389323 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-e24772f6-fa98-4ceb-8953-fc5cc69e41f7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:36.399565 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e24772f6-fa98-4ceb-8953-fc5cc69e41f7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:36.400029 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e24772f6-fa98-4ceb-8953-fc5cc69e41f7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:36.401869 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e24772f6-fa98-4ceb-8953-fc5cc69e41f7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:36.402311 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-e24772f6-fa98-4ceb-8953-fc5cc69e41f7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:36.477112 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-e24772f6-fa98-4ceb-8953-fc5cc69e41f7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:36.484590 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-e24772f6-fa98-4ceb-8953-fc5cc69e41f7 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1300 microversion: 2.1 time: 0.100143 Mar 30 07:25:36.485182 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 482/984] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:36 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:37.502183 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-a7da7f0c-40c2-4e99-b0d6-af620260825b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:37.503689 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-a7da7f0c-40c2-4e99-b0d6-af620260825b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:37.510830 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7da7f0c-40c2-4e99-b0d6-af620260825b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:37.511278 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7da7f0c-40c2-4e99-b0d6-af620260825b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:37.512068 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7da7f0c-40c2-4e99-b0d6-af620260825b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:37.512539 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-a7da7f0c-40c2-4e99-b0d6-af620260825b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:37.728608 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-a7da7f0c-40c2-4e99-b0d6-af620260825b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:37.736825 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-a7da7f0c-40c2-4e99-b0d6-af620260825b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1368 microversion: 2.1 time: 0.238700 Mar 30 07:25:37.737681 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 503/985] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:37 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:37.779296 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-fec2d59b-ff5f-4584-96dc-6627ac31b216 req-1f0e4f20-2584-4803-8f13-317a9014fee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e4bd60-8203-468a-a399-1460dc70c586", "tag": "bcc95429-80a4-4892-8e07-14e700a2c5a2"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:37.789447 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-fec2d59b-ff5f-4584-96dc-6627ac31b216 req-1f0e4f20-2584-4803-8f13-317a9014fee9 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:37.789847 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-fec2d59b-ff5f-4584-96dc-6627ac31b216 req-1f0e4f20-2584-4803-8f13-317a9014fee9 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:37.802098 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-fec2d59b-ff5f-4584-96dc-6627ac31b216 req-1f0e4f20-2584-4803-8f13-317a9014fee9 service nova] Creating event network-changed:bcc95429-80a4-4892-8e07-14e700a2c5a2 for instance f2e4bd60-8203-468a-a399-1460dc70c586 on hv-cinder-83577 Mar 30 07:25:37.807236 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-fec2d59b-ff5f-4584-96dc-6627ac31b216 req-1f0e4f20-2584-4803-8f13-317a9014fee9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031657 Mar 30 07:25:37.807891 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 483/986] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:25:38.754263 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3b25b545-0708-4c8b-88d1-36acf5d3db2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:38.755024 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-3b25b545-0708-4c8b-88d1-36acf5d3db2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:38.761304 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3b25b545-0708-4c8b-88d1-36acf5d3db2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:38.761746 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3b25b545-0708-4c8b-88d1-36acf5d3db2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:38.762505 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3b25b545-0708-4c8b-88d1-36acf5d3db2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:38.762932 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-3b25b545-0708-4c8b-88d1-36acf5d3db2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:38.921822 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-3b25b545-0708-4c8b-88d1-36acf5d3db2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:38.929911 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3b25b545-0708-4c8b-88d1-36acf5d3db2b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1368 microversion: 2.1 time: 0.179898 Mar 30 07:25:38.930491 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 504/987] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:38 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:39.953042 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-60e05b80-4683-4589-872e-39dd6c32eb5b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:39.954152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-60e05b80-4683-4589-872e-39dd6c32eb5b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:39.961747 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-60e05b80-4683-4589-872e-39dd6c32eb5b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:39.962193 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-60e05b80-4683-4589-872e-39dd6c32eb5b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:39.962961 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-60e05b80-4683-4589-872e-39dd6c32eb5b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:39.963396 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-60e05b80-4683-4589-872e-39dd6c32eb5b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:40.120988 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-60e05b80-4683-4589-872e-39dd6c32eb5b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:40.131077 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-60e05b80-4683-4589-872e-39dd6c32eb5b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1368 microversion: 2.1 time: 0.185975 Mar 30 07:25:40.131667 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 484/988] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:39 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:41.148190 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c06904ab-c6f2-4388-82e8-9c50269f65ea tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:41.148803 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-c06904ab-c6f2-4388-82e8-9c50269f65ea tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:41.157204 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c06904ab-c6f2-4388-82e8-9c50269f65ea tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:41.157654 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c06904ab-c6f2-4388-82e8-9c50269f65ea tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:41.158440 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c06904ab-c6f2-4388-82e8-9c50269f65ea tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:41.159207 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-c06904ab-c6f2-4388-82e8-9c50269f65ea tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:41.292824 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-c06904ab-c6f2-4388-82e8-9c50269f65ea tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:41.300489 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c06904ab-c6f2-4388-82e8-9c50269f65ea tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1368 microversion: 2.1 time: 0.156724 Mar 30 07:25:41.301057 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 505/989] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:41 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:42.322156 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7c3434df-cf10-4cec-b81a-53877fc28f34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:42.323161 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7c3434df-cf10-4cec-b81a-53877fc28f34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:42.334167 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c3434df-cf10-4cec-b81a-53877fc28f34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:42.334913 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c3434df-cf10-4cec-b81a-53877fc28f34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:42.336243 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c3434df-cf10-4cec-b81a-53877fc28f34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:42.336966 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7c3434df-cf10-4cec-b81a-53877fc28f34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:42.494906 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-7c3434df-cf10-4cec-b81a-53877fc28f34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:42.503580 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7c3434df-cf10-4cec-b81a-53877fc28f34 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1368 microversion: 2.1 time: 0.188394 Mar 30 07:25:42.504178 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 485/990] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:42 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:43.166856 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-43171d9d-b11c-426f-a613-cb938bd5dd48 req-fbb7ab03-bc06-4135-beb0-f9b8b59418de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e4bd60-8203-468a-a399-1460dc70c586", "name": "network-vif-plugged", "status": "completed", "tag": "bcc95429-80a4-4892-8e07-14e700a2c5a2"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:43.176793 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-43171d9d-b11c-426f-a613-cb938bd5dd48 req-fbb7ab03-bc06-4135-beb0-f9b8b59418de service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:43.177235 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-43171d9d-b11c-426f-a613-cb938bd5dd48 req-fbb7ab03-bc06-4135-beb0-f9b8b59418de service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:43.192906 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-43171d9d-b11c-426f-a613-cb938bd5dd48 req-fbb7ab03-bc06-4135-beb0-f9b8b59418de service nova] Creating event network-vif-plugged:bcc95429-80a4-4892-8e07-14e700a2c5a2 for instance f2e4bd60-8203-468a-a399-1460dc70c586 on hv-cinder-83577 Mar 30 07:25:43.200765 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-43171d9d-b11c-426f-a613-cb938bd5dd48 req-fbb7ab03-bc06-4135-beb0-f9b8b59418de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037766 Mar 30 07:25:43.201337 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 506/991] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:25:43.525565 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1f327943-3c09-4a4c-8c53-ce325c86ffbf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:43.526528 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-1f327943-3c09-4a4c-8c53-ce325c86ffbf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:43.532699 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1f327943-3c09-4a4c-8c53-ce325c86ffbf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:43.533144 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1f327943-3c09-4a4c-8c53-ce325c86ffbf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:43.534170 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1f327943-3c09-4a4c-8c53-ce325c86ffbf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:43.534719 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-1f327943-3c09-4a4c-8c53-ce325c86ffbf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:43.680172 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-1f327943-3c09-4a4c-8c53-ce325c86ffbf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:43.688451 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1f327943-3c09-4a4c-8c53-ce325c86ffbf tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1368 microversion: 2.1 time: 0.166852 Mar 30 07:25:43.689021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 486/992] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:43 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:44.711438 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0bf6ed78-0853-433a-8343-5904fa574699 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:44.712484 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0bf6ed78-0853-433a-8343-5904fa574699 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:44.722708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bf6ed78-0853-433a-8343-5904fa574699 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:44.723164 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bf6ed78-0853-433a-8343-5904fa574699 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:44.723979 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bf6ed78-0853-433a-8343-5904fa574699 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:44.724428 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bf6ed78-0853-433a-8343-5904fa574699 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:44.863992 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-0bf6ed78-0853-433a-8343-5904fa574699 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:25:44.871714 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0bf6ed78-0853-433a-8343-5904fa574699 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1558 microversion: 2.1 time: 0.168352 Mar 30 07:25:44.872288 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 507/993] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:25:44 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:25:44.891132 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-03570df8-fbeb-4edb-9f7f-97856c1d1959 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:25:44.891971 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-03570df8-fbeb-4edb-9f7f-97856c1d1959 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:25:44.899122 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03570df8-fbeb-4edb-9f7f-97856c1d1959 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:44.899573 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03570df8-fbeb-4edb-9f7f-97856c1d1959 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:44.900376 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03570df8-fbeb-4edb-9f7f-97856c1d1959 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:44.900813 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-03570df8-fbeb-4edb-9f7f-97856c1d1959 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:44.991798 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-03570df8-fbeb-4edb-9f7f-97856c1d1959 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106757 Mar 30 07:25:44.992775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 487/994] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Mar 30 07:25:44 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:25:45.978561 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-80c47aae-335e-417e-a779-d53a2036e860 req-02ac0dbb-c712-492c-911b-087b62120d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e4bd60-8203-468a-a399-1460dc70c586", "tag": "bcc95429-80a4-4892-8e07-14e700a2c5a2"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:25:45.987756 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-80c47aae-335e-417e-a779-d53a2036e860 req-02ac0dbb-c712-492c-911b-087b62120d64 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:25:45.988477 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-80c47aae-335e-417e-a779-d53a2036e860 req-02ac0dbb-c712-492c-911b-087b62120d64 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:25:45.999656 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-80c47aae-335e-417e-a779-d53a2036e860 req-02ac0dbb-c712-492c-911b-087b62120d64 service nova] Creating event network-changed:bcc95429-80a4-4892-8e07-14e700a2c5a2 for instance f2e4bd60-8203-468a-a399-1460dc70c586 on hv-cinder-83577 Mar 30 07:25:46.004881 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-80c47aae-335e-417e-a779-d53a2036e860 req-02ac0dbb-c712-492c-911b-087b62120d64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030466 Mar 30 07:25:46.006026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 508/995] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:22.008603 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7dc2c292-a4b8-44ac-b1b4-05d7e47b32b5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:22.009263 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-7dc2c292-a4b8-44ac-b1b4-05d7e47b32b5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:22.017370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7dc2c292-a4b8-44ac-b1b4-05d7e47b32b5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:22.017822 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7dc2c292-a4b8-44ac-b1b4-05d7e47b32b5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:22.018597 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7dc2c292-a4b8-44ac-b1b4-05d7e47b32b5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:22.019028 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-7dc2c292-a4b8-44ac-b1b4-05d7e47b32b5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:22.047786 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7dc2c292-a4b8-44ac-b1b4-05d7e47b32b5 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/ips" status: 200 len: 150 microversion: 2.1 time: 0.045113 Mar 30 07:26:22.048379 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 488/996] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:26:22 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:23.400639 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-f64f241e-da08-4191-8ad9-21686952d77a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69c42a84-ccc7-4206-88b6-58a18bb3d5dc"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:26:23.401785 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-f64f241e-da08-4191-8ad9-21686952d77a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:23.408548 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f64f241e-da08-4191-8ad9-21686952d77a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:23.408997 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f64f241e-da08-4191-8ad9-21686952d77a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:23.409760 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f64f241e-da08-4191-8ad9-21686952d77a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:23.410226 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-f64f241e-da08-4191-8ad9-21686952d77a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:23.686750 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-f64f241e-da08-4191-8ad9-21686952d77a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "POST /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290310 Mar 30 07:26:23.687398 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 509/997] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Mar 30 07:26:23 2022] POST /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:30.453886 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-77ec6a4e-875f-4176-84dc-206618c2a9cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:30.454418 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-77ec6a4e-875f-4176-84dc-206618c2a9cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:30.461403 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-77ec6a4e-875f-4176-84dc-206618c2a9cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:30.461849 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-77ec6a4e-875f-4176-84dc-206618c2a9cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:30.462607 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-77ec6a4e-875f-4176-84dc-206618c2a9cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:30.463036 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-77ec6a4e-875f-4176-84dc-206618c2a9cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:30.542405 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.objects.instance [None req-77ec6a4e-875f-4176-84dc-206618c2a9cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lazy-loading 'services' on Instance uuid f2e4bd60-8203-468a-a399-1460dc70c586 {{(pid=117063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:26:30.615968 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-77ec6a4e-875f-4176-84dc-206618c2a9cc tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-volume_attachments/69c42a84-ccc7-4206-88b6-58a18bb3d5dc" status: 202 len: 0 microversion: 2.1 time: 0.165806 Mar 30 07:26:30.616817 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 489/998] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Mar 30 07:26:30 2022] DELETE /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-volume_attachments/69c42a84-ccc7-4206-88b6-58a18bb3d5dc => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:26:30.627830 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ebe37edb-cc80-4535-b6de-1f767ade621b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:30.629084 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ebe37edb-cc80-4535-b6de-1f767ade621b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:30.636554 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ebe37edb-cc80-4535-b6de-1f767ade621b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:30.637009 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ebe37edb-cc80-4535-b6de-1f767ade621b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:30.637800 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ebe37edb-cc80-4535-b6de-1f767ade621b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:30.638234 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ebe37edb-cc80-4535-b6de-1f767ade621b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:30.668483 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ebe37edb-cc80-4535-b6de-1f767ade621b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046184 Mar 30 07:26:30.669077 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 510/999] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:26:30 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:31.686277 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-dd601733-eee2-4fd4-9406-aa0f54569f2c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:31.687909 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-dd601733-eee2-4fd4-9406-aa0f54569f2c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:31.698654 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dd601733-eee2-4fd4-9406-aa0f54569f2c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:31.699397 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dd601733-eee2-4fd4-9406-aa0f54569f2c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:31.700721 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dd601733-eee2-4fd4-9406-aa0f54569f2c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:31.701445 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-dd601733-eee2-4fd4-9406-aa0f54569f2c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:31.732293 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-dd601733-eee2-4fd4-9406-aa0f54569f2c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054135 Mar 30 07:26:31.732843 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 490/1000] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Mar 30 07:26:31 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 30 07:26:31.789384 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-614f9120-6e18-4900-85e9-6e2d5700253d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:31.789909 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-614f9120-6e18-4900-85e9-6e2d5700253d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:31.796547 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-614f9120-6e18-4900-85e9-6e2d5700253d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:31.796998 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-614f9120-6e18-4900-85e9-6e2d5700253d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:31.797768 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-614f9120-6e18-4900-85e9-6e2d5700253d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:31.798199 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-614f9120-6e18-4900-85e9-6e2d5700253d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:31.828851 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-614f9120-6e18-4900-85e9-6e2d5700253d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Going to try to terminate instance {{(pid=117062) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:26:31.910688 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-614f9120-6e18-4900-85e9-6e2d5700253d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 204 len: 0 microversion: 2.1 time: 0.124620 Mar 30 07:26:31.911546 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 511/1001] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:26:31 2022] DELETE /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:26:31.921574 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3b3fe7bb-afa5-4bcd-9b1b-47386b17db00 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:31.922685 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3b3fe7bb-afa5-4bcd-9b1b-47386b17db00 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:31.931697 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3b3fe7bb-afa5-4bcd-9b1b-47386b17db00 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:31.932163 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3b3fe7bb-afa5-4bcd-9b1b-47386b17db00 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:31.932934 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3b3fe7bb-afa5-4bcd-9b1b-47386b17db00 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:31.933360 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3b3fe7bb-afa5-4bcd-9b1b-47386b17db00 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:32.094912 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3b3fe7bb-afa5-4bcd-9b1b-47386b17db00 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:32.103047 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3b3fe7bb-afa5-4bcd-9b1b-47386b17db00 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1683 microversion: 2.1 time: 0.186802 Mar 30 07:26:32.103597 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 491/1002] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:31 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:33.126184 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-81696fa1-f830-4cc8-9013-b54e349c6774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:33.127338 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-81696fa1-f830-4cc8-9013-b54e349c6774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:33.138637 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-81696fa1-f830-4cc8-9013-b54e349c6774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:33.139386 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-81696fa1-f830-4cc8-9013-b54e349c6774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:33.140837 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-81696fa1-f830-4cc8-9013-b54e349c6774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:33.141584 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-81696fa1-f830-4cc8-9013-b54e349c6774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:33.293708 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-81696fa1-f830-4cc8-9013-b54e349c6774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:33.305879 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-81696fa1-f830-4cc8-9013-b54e349c6774 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1683 microversion: 2.1 time: 0.186652 Mar 30 07:26:33.306610 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 512/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:33 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:34.328101 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b4230b8b-b516-40f9-84b1-2c15193da285 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:34.329212 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b4230b8b-b516-40f9-84b1-2c15193da285 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:34.340564 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4230b8b-b516-40f9-84b1-2c15193da285 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:34.341376 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4230b8b-b516-40f9-84b1-2c15193da285 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:34.342764 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4230b8b-b516-40f9-84b1-2c15193da285 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:34.343521 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b4230b8b-b516-40f9-84b1-2c15193da285 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:34.456298 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b4230b8b-b516-40f9-84b1-2c15193da285 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a49ff45f0e43958ceeffd704999f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2482f983870c40ad8fe2e8a9ae69169c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:34.465236 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b4230b8b-b516-40f9-84b1-2c15193da285 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 200 len: 1615 microversion: 2.1 time: 0.144906 Mar 30 07:26:34.466495 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 492/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:34 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 1615 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:34.493114 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-7329ba28-070c-40e5-b6ba-f83b2ded79fc req-26de1ffb-9f64-480d-88eb-4822ed981635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e4bd60-8203-468a-a399-1460dc70c586", "name": "network-vif-deleted", "tag": "bcc95429-80a4-4892-8e07-14e700a2c5a2"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:26:34.502840 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-7329ba28-070c-40e5-b6ba-f83b2ded79fc req-26de1ffb-9f64-480d-88eb-4822ed981635 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:34.503256 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-7329ba28-070c-40e5-b6ba-f83b2ded79fc req-26de1ffb-9f64-480d-88eb-4822ed981635 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:34.515247 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-7329ba28-070c-40e5-b6ba-f83b2ded79fc req-26de1ffb-9f64-480d-88eb-4822ed981635 service nova] Creating event network-vif-deleted:bcc95429-80a4-4892-8e07-14e700a2c5a2 for instance f2e4bd60-8203-468a-a399-1460dc70c586 on hv-cinder-83577 Mar 30 07:26:34.521680 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-7329ba28-070c-40e5-b6ba-f83b2ded79fc req-26de1ffb-9f64-480d-88eb-4822ed981635 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032033 Mar 30 07:26:34.524088 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 513/1005] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:35.222630 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-815ccad8-5d1e-4b08-b101-53bb2f93c1b4 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:35.223345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-815ccad8-5d1e-4b08-b101-53bb2f93c1b4 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:35.230572 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-815ccad8-5d1e-4b08-b101-53bb2f93c1b4 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:35.231251 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-815ccad8-5d1e-4b08-b101-53bb2f93c1b4 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:35.232237 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-815ccad8-5d1e-4b08-b101-53bb2f93c1b4 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:35.232831 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-815ccad8-5d1e-4b08-b101-53bb2f93c1b4 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:35.260410 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-815ccad8-5d1e-4b08-b101-53bb2f93c1b4 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:26:35.301187 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-2062074a-a291-4b6f-b6a1-8580f6950b44 req-b93bbe13-7f1a-4e05-9bd2-a257ae071ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb5355d-cff6-45b6-a2f6-4527a3c77467", "tag": "7a189a71-9b20-445d-864b-af349fb8f6a9"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:26:35.311194 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-2062074a-a291-4b6f-b6a1-8580f6950b44 req-b93bbe13-7f1a-4e05-9bd2-a257ae071ea6 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:35.311640 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-2062074a-a291-4b6f-b6a1-8580f6950b44 req-b93bbe13-7f1a-4e05-9bd2-a257ae071ea6 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:35.330264 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-2062074a-a291-4b6f-b6a1-8580f6950b44 req-b93bbe13-7f1a-4e05-9bd2-a257ae071ea6 service nova] Creating event network-changed:7a189a71-9b20-445d-864b-af349fb8f6a9 for instance 6bb5355d-cff6-45b6-a2f6-4527a3c77467 on hv-cinder-83577 Mar 30 07:26:35.336340 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-2062074a-a291-4b6f-b6a1-8580f6950b44 req-b93bbe13-7f1a-4e05-9bd2-a257ae071ea6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106247 Mar 30 07:26:35.340405 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 514/1006] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:26:35.371182 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-815ccad8-5d1e-4b08-b101-53bb2f93c1b4 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 204 len: 0 microversion: 2.1 time: 0.152331 Mar 30 07:26:35.372911 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 493/1007] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:26:35 2022] DELETE /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:26:35.382515 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-dbd86ff9-0a2c-4aed-8c4e-8c58028c6651 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:35.383260 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-dbd86ff9-0a2c-4aed-8c4e-8c58028c6651 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:35.390329 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dbd86ff9-0a2c-4aed-8c4e-8c58028c6651 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:35.390805 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dbd86ff9-0a2c-4aed-8c4e-8c58028c6651 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:35.392120 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dbd86ff9-0a2c-4aed-8c4e-8c58028c6651 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:35.392705 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-dbd86ff9-0a2c-4aed-8c4e-8c58028c6651 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:35.485984 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:35.486951 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:35.495592 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:35.496352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:35.497602 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:35.499516 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:35.517907 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance f2e4bd60-8203-468a-a399-1460dc70c586 could not be found. Mar 30 07:26:35.519104 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance f2e4bd60-8203-468a-a399-1460dc70c586 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:35.520152 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0c51eada-b0a7-4782-ad8b-e2bf7aac6e81 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 404 len: 111 microversion: 2.1 time: 0.040887 Mar 30 07:26:35.524362 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 494/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:35 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 30 07:26:35.531080 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9820f0ff-663f-43b1-b31f-8116eebd814d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '.version_select at 0x7f154c0f9550>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:35.556969 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9820f0ff-663f-43b1-b31f-8116eebd814d tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111086980" status: 202 len: 0 microversion: 2.1 time: 0.031309 Mar 30 07:26:35.557859 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 495/1009] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Mar 30 07:26:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111086980 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 30 07:26:35.623420 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-dbd86ff9-0a2c-4aed-8c4e-8c58028c6651 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:35.635449 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-dbd86ff9-0a2c-4aed-8c4e-8c58028c6651 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1578 microversion: 2.1 time: 0.253669 Mar 30 07:26:35.636352 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 515/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:35 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1578 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:36.657768 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-3b203abe-0282-4fd1-b4c6-1580064241bd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:36.658398 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-3b203abe-0282-4fd1-b4c6-1580064241bd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:36.671137 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3b203abe-0282-4fd1-b4c6-1580064241bd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:36.671752 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3b203abe-0282-4fd1-b4c6-1580064241bd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:36.672775 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3b203abe-0282-4fd1-b4c6-1580064241bd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:36.673498 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-3b203abe-0282-4fd1-b4c6-1580064241bd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:36.822049 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-3b203abe-0282-4fd1-b4c6-1580064241bd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:36.829881 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-3b203abe-0282-4fd1-b4c6-1580064241bd tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1460 microversion: 2.1 time: 0.179637 Mar 30 07:26:36.830449 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 496/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:36 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1460 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:37.384629 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:37.385168 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:37.391407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:37.391863 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:37.392657 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:37.393154 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:37.406641 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance f2e4bd60-8203-468a-a399-1460dc70c586 could not be found. Mar 30 07:26:37.407226 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance f2e4bd60-8203-468a-a399-1460dc70c586 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:37.408059 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-e1fee11e-dbe3-4ada-8748-edddb556a43a tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 404 len: 111 microversion: 2.1 time: 0.027282 Mar 30 07:26:37.408622 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 516/1012] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:26:37 2022] DELETE /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:37.417068 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:37.417704 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: f2e4bd60-8203-468a-a399-1460dc70c586] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:37.423545 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:37.424012 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:37.424874 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:37.425414 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:37.439172 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance f2e4bd60-8203-468a-a399-1460dc70c586 could not be found. Mar 30 07:26:37.439761 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance f2e4bd60-8203-468a-a399-1460dc70c586 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:37.440870 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-c923f02e-5d51-4478-984f-25bf2909ed7c tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586" status: 404 len: 111 microversion: 2.1 time: 0.027776 Mar 30 07:26:37.441389 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 497/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:37 2022] GET /compute/v2.1/servers/f2e4bd60-8203-468a-a399-1460dc70c586 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:37.702956 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-3b7abb99-3007-40f8-bf87-908b02bf8a68 req-1697e782-9da1-4050-9681-17137cbd6ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb5355d-cff6-45b6-a2f6-4527a3c77467", "name": "network-vif-deleted", "tag": "7a189a71-9b20-445d-864b-af349fb8f6a9"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:26:37.713616 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-3b7abb99-3007-40f8-bf87-908b02bf8a68 req-1697e782-9da1-4050-9681-17137cbd6ad8 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:37.714145 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-3b7abb99-3007-40f8-bf87-908b02bf8a68 req-1697e782-9da1-4050-9681-17137cbd6ad8 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:37.725528 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-3b7abb99-3007-40f8-bf87-908b02bf8a68 req-1697e782-9da1-4050-9681-17137cbd6ad8 service nova] Creating event network-vif-deleted:7a189a71-9b20-445d-864b-af349fb8f6a9 for instance 6bb5355d-cff6-45b6-a2f6-4527a3c77467 on hv-cinder-83577 Mar 30 07:26:37.731086 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-3b7abb99-3007-40f8-bf87-908b02bf8a68 req-1697e782-9da1-4050-9681-17137cbd6ad8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031960 Mar 30 07:26:37.731709 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 517/1014] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:37.848660 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b799115f-bac2-4916-bfe4-ae91b9e1d52a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:37.849225 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-b799115f-bac2-4916-bfe4-ae91b9e1d52a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:37.856543 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b799115f-bac2-4916-bfe4-ae91b9e1d52a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:37.857049 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b799115f-bac2-4916-bfe4-ae91b9e1d52a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:37.857857 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b799115f-bac2-4916-bfe4-ae91b9e1d52a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:37.858288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-b799115f-bac2-4916-bfe4-ae91b9e1d52a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:37.918753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-b799115f-bac2-4916-bfe4-ae91b9e1d52a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:37.926526 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b799115f-bac2-4916-bfe4-ae91b9e1d52a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 200 len: 1226 microversion: 2.1 time: 0.082058 Mar 30 07:26:37.927086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 498/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:37 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:38.577343 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:38.577974 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:38.584886 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.585345 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.586119 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.586573 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.600250 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance d287ae8d-8382-4023-8788-f8789b1368d8 could not be found. Mar 30 07:26:38.600841 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance d287ae8d-8382-4023-8788-f8789b1368d8 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:38.601685 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0bb2c6f7-6f96-45ae-9ada-b4383b4cb249 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 404 len: 111 microversion: 2.1 time: 0.029178 Mar 30 07:26:38.602575 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 518/1016] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:26:38 2022] DELETE /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:38.610844 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:38.611458 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: d287ae8d-8382-4023-8788-f8789b1368d8] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:38.617903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.618356 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.619118 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.619579 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.633229 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance d287ae8d-8382-4023-8788-f8789b1368d8 could not be found. Mar 30 07:26:38.633786 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance d287ae8d-8382-4023-8788-f8789b1368d8 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:38.634597 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-4a388bc2-2aec-4239-9469-0325e57e2a23 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8" status: 404 len: 111 microversion: 2.1 time: 0.027869 Mar 30 07:26:38.635126 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 499/1017] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:38 2022] GET /compute/v2.1/servers/d287ae8d-8382-4023-8788-f8789b1368d8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:38.643054 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:38.643572 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:38.650203 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.650638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.651400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.651855 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.665284 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance c4e27669-29a8-48a3-b442-ee2cc19176c3 could not be found. Mar 30 07:26:38.665904 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance c4e27669-29a8-48a3-b442-ee2cc19176c3 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:38.666734 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-ca4fb8ae-2eb3-4356-8e90-f9931f70da9b tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 404 len: 111 microversion: 2.1 time: 0.027544 Mar 30 07:26:38.667284 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 519/1018] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:26:38 2022] DELETE /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:38.675345 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:38.675989 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: c4e27669-29a8-48a3-b442-ee2cc19176c3] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:38.684086 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.684759 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.685943 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.686560 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.701614 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance c4e27669-29a8-48a3-b442-ee2cc19176c3 could not be found. Mar 30 07:26:38.702202 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance c4e27669-29a8-48a3-b442-ee2cc19176c3 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:38.703031 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-319d3ce2-dace-43e0-92ed-235432cfb048 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3" status: 404 len: 111 microversion: 2.1 time: 0.031590 Mar 30 07:26:38.703572 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 500/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:38 2022] GET /compute/v2.1/servers/c4e27669-29a8-48a3-b442-ee2cc19176c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:38.943444 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:38.944083 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 6bb5355d-cff6-45b6-a2f6-4527a3c77467] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:38.950379 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.950831 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.951595 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:38.952060 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:38.965556 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] HTTP exception thrown: Instance 6bb5355d-cff6-45b6-a2f6-4527a3c77467 could not be found. Mar 30 07:26:38.966188 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Returning 404 to user: Instance 6bb5355d-cff6-45b6-a2f6-4527a3c77467 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:38.967018 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5a811189-ea3f-4fc5-9fe7-e62b8cb0ee43 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467" status: 404 len: 111 microversion: 2.1 time: 0.027574 Mar 30 07:26:38.967791 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 520/1020] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:38 2022] GET /compute/v2.1/servers/6bb5355d-cff6-45b6-a2f6-4527a3c77467 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:39.847671 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:39.848239 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:39.855257 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:39.855705 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:39.856503 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:39.856935 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:39.870791 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance fb553a5a-a341-4f34-9d09-4082d87fc076 could not be found. Mar 30 07:26:39.871352 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance fb553a5a-a341-4f34-9d09-4082d87fc076 could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:39.872205 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-30ee33ef-fb82-4729-8a2a-7f351313dd38 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 404 len: 111 microversion: 2.1 time: 0.028582 Mar 30 07:26:39.872735 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 501/1021] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:26:39 2022] DELETE /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:39.880882 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:39.881459 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] [instance: fb553a5a-a341-4f34-9d09-4082d87fc076] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:39.887912 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:39.888365 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:39.889159 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:39.889583 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:39.902652 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] HTTP exception thrown: Instance fb553a5a-a341-4f34-9d09-4082d87fc076 could not be found. Mar 30 07:26:39.903227 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] Returning 404 to user: Instance fb553a5a-a341-4f34-9d09-4082d87fc076 could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:39.904072 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-76f5b040-8340-40bc-8d31-5fa4bf3e4311 tempest-AttachVolumeNegativeTest-493976892 tempest-AttachVolumeNegativeTest-493976892-project] 10.222.0.20 "GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076" status: 404 len: 111 microversion: 2.1 time: 0.027124 Mar 30 07:26:39.904626 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 521/1022] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:39 2022] GET /compute/v2.1/servers/fb553a5a-a341-4f34-9d09-4082d87fc076 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:42.134113 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-9f0c68d1-5d05-4650-9d53-caca81c1b218 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:42.134736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9f0c68d1-5d05-4650-9d53-caca81c1b218 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:42.142466 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [req-25260c70-0bc1-4e4e-9493-81580c0340eb req-27980e55-8c38-4896-989f-850295c1bb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153dd568-5bf9-4ddc-9221-8fe74c4bd58b", "tag": "ec40b8bb-3831-42fc-bb08-d0b7a674e052"}]} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:26:42.146875 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f0c68d1-5d05-4650-9d53-caca81c1b218 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:42.147382 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f0c68d1-5d05-4650-9d53-caca81c1b218 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:42.148426 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f0c68d1-5d05-4650-9d53-caca81c1b218 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:42.148933 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-9f0c68d1-5d05-4650-9d53-caca81c1b218 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:42.152268 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-25260c70-0bc1-4e4e-9493-81580c0340eb req-27980e55-8c38-4896-989f-850295c1bb79 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:42.152860 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [req-25260c70-0bc1-4e4e-9493-81580c0340eb req-27980e55-8c38-4896-989f-850295c1bb79 service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:42.170543 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.compute.server_external_events [req-25260c70-0bc1-4e4e-9493-81580c0340eb req-27980e55-8c38-4896-989f-850295c1bb79 service nova] Creating event network-changed:ec40b8bb-3831-42fc-bb08-d0b7a674e052 for instance 153dd568-5bf9-4ddc-9221-8fe74c4bd58b on hv-cinder-83577 Mar 30 07:26:42.177324 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [req-25260c70-0bc1-4e4e-9493-81580c0340eb req-27980e55-8c38-4896-989f-850295c1bb79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040600 Mar 30 07:26:42.178455 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 522/1023] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:42.187801 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-9f0c68d1-5d05-4650-9d53-caca81c1b218 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Going to try to terminate instance {{(pid=117063) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 30 07:26:42.273687 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-9f0c68d1-5d05-4650-9d53-caca81c1b218 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "DELETE /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 204 len: 0 microversion: 2.1 time: 0.143183 Mar 30 07:26:42.274746 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 502/1024] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:26:42 2022] DELETE /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 30 07:26:42.285248 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2e938e49-dc8b-4c31-92f8-d1c06c2cd02a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:42.286050 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2e938e49-dc8b-4c31-92f8-d1c06c2cd02a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:42.296633 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2e938e49-dc8b-4c31-92f8-d1c06c2cd02a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:42.297341 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2e938e49-dc8b-4c31-92f8-d1c06c2cd02a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:42.298952 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2e938e49-dc8b-4c31-92f8-d1c06c2cd02a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:42.300072 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2e938e49-dc8b-4c31-92f8-d1c06c2cd02a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:42.714766 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-2e938e49-dc8b-4c31-92f8-d1c06c2cd02a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:42.722519 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2e938e49-dc8b-4c31-92f8-d1c06c2cd02a tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1576 microversion: 2.1 time: 0.442852 Mar 30 07:26:42.733615 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 523/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:42 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1576 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:43.741558 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-37b535b2-d9e4-4d9f-afdd-b290b92fa214 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:43.742254 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-37b535b2-d9e4-4d9f-afdd-b290b92fa214 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:43.748794 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-37b535b2-d9e4-4d9f-afdd-b290b92fa214 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:43.749239 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-37b535b2-d9e4-4d9f-afdd-b290b92fa214 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:43.750019 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-37b535b2-d9e4-4d9f-afdd-b290b92fa214 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:43.750442 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-37b535b2-d9e4-4d9f-afdd-b290b92fa214 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:44.192288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.policy [None req-37b535b2-d9e4-4d9f-afdd-b290b92fa214 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117063) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:44.205492 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-37b535b2-d9e4-4d9f-afdd-b290b92fa214 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1458 microversion: 2.1 time: 0.468474 Mar 30 07:26:44.206370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 503/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:43 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1458 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:44.556676 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-bf1cb996-a57b-44d2-84f3-dfe53df28f17 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Action: 'create', calling method: .version_select at 0x7f154d0a9c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1694578299"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:26:44.642640 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [req-2fa75b18-0889-4fa3-afe2-b29bd2c7eb04 req-c38d94c9-6b2a-4475-9e8a-154e8f9897bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153dd568-5bf9-4ddc-9221-8fe74c4bd58b", "name": "network-vif-deleted", "tag": "ec40b8bb-3831-42fc-bb08-d0b7a674e052"}]} {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:26:44.658370 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-2fa75b18-0889-4fa3-afe2-b29bd2c7eb04 req-c38d94c9-6b2a-4475-9e8a-154e8f9897bb service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:44.658909 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [req-2fa75b18-0889-4fa3-afe2-b29bd2c7eb04 req-c38d94c9-6b2a-4475-9e8a-154e8f9897bb service nova] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:44.671021 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.compute.server_external_events [req-2fa75b18-0889-4fa3-afe2-b29bd2c7eb04 req-c38d94c9-6b2a-4475-9e8a-154e8f9897bb service nova] Creating event network-vif-deleted:ec40b8bb-3831-42fc-bb08-d0b7a674e052 for instance 153dd568-5bf9-4ddc-9221-8fe74c4bd58b on hv-cinder-83577 Mar 30 07:26:44.676150 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [req-2fa75b18-0889-4fa3-afe2-b29bd2c7eb04 req-c38d94c9-6b2a-4475-9e8a-154e8f9897bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037322 Mar 30 07:26:44.676884 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 504/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Mar 30 07:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:44.856730 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-bf1cb996-a57b-44d2-84f3-dfe53df28f17 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.413818 Mar 30 07:26:44.857429 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 524/1028] 10.222.0.20 () {60 vars in 1154 bytes} [Wed Mar 30 07:26:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 415 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 30 07:26:44.870074 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-923cf63d-0142-435c-a427-30ddd63d1f6e tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154c0f9430>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:44.923230 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-923cf63d-0142-435c-a427-30ddd63d1f6e tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd" status: 200 len: 345 microversion: 2.1 time: 0.057530 Mar 30 07:26:44.924280 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 505/1029] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:26:44 2022] GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:45.223216 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:45.223843 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:45.231470 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:45.231964 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:45.232765 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:45.233182 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:45.263934 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:45.264382 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:45.264826 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.objects.instance [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lazy-loading 'fault' on Instance uuid 153dd568-5bf9-4ddc-9221-8fe74c4bd58b {{(pid=117062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 30 07:26:45.309391 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.policy [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e427dd29ea4380b01a1c257cc3da00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803772b9959c49c988cb738b94678917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117062) authorize /opt/stack/nova/nova/policy.py:199}} Mar 30 07:26:45.317324 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9df4e2ee-ca2d-4601-b8c5-c06c3f409e4d tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 200 len: 1230 microversion: 2.1 time: 0.098083 Mar 30 07:26:45.318181 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 525/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:45 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 30 07:26:45.942509 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-1bfbdfa5-da03-4d1c-825e-da850a057cb2 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154da969d0>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:46.001395 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-1bfbdfa5-da03-4d1c-825e-da850a057cb2 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd" status: 200 len: 346 microversion: 2.1 time: 0.066404 Mar 30 07:26:46.001989 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 506/1031] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:26:45 2022] GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:46.013407 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-4166ef35-a1d9-4d32-9619-ecd35caba833 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Action: 'create', calling method: .version_select at 0x7f154d0caf70>, body: {"snapshot": {"volume_id": "cb13f0dc-84ba-4f57-8788-56e4ba24d2fd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-350700149"}} {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 30 07:26:46.165305 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-4166ef35-a1d9-4d32-9619-ecd35caba833 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.155755 Mar 30 07:26:46.165902 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 526/1032] 10.222.0.20 () {60 vars in 1161 bytes} [Wed Mar 30 07:26:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:46.175845 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-0ab0ca1b-d15f-4426-9ccf-4b257d1602e8 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f153fe86550>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:46.205540 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-0ab0ca1b-d15f-4426-9ccf-4b257d1602e8 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e" status: 200 len: 286 microversion: 2.1 time: 0.033530 Mar 30 07:26:46.206137 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 507/1033] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Mar 30 07:26:46 2022] GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:46.215948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-c5fe080f-fbee-439d-9340-984a7d39d92e tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154d1c0040>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:46.246606 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-c5fe080f-fbee-439d-9340-984a7d39d92e tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034407 Mar 30 07:26:46.247172 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 527/1034] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Mar 30 07:26:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:46.257092 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b190265b-0b8a-474d-ad7a-ef7f10f81828 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f153ff84a60>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:46.285061 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b190265b-0b8a-474d-ad7a-ef7f10f81828 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e" status: 200 len: 286 microversion: 2.1 time: 0.031809 Mar 30 07:26:46.285646 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 508/1035] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Mar 30 07:26:46 2022] GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:46.335513 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:46.336178 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 153dd568-5bf9-4ddc-9221-8fe74c4bd58b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:46.344660 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:46.345111 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:46.345897 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:46.346331 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:46.360962 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] HTTP exception thrown: Instance 153dd568-5bf9-4ddc-9221-8fe74c4bd58b could not be found. Mar 30 07:26:46.361507 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Returning 404 to user: Instance 153dd568-5bf9-4ddc-9221-8fe74c4bd58b could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:46.362356 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-2bf823ed-da2f-47bf-9f6a-5c39de145795 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b" status: 404 len: 111 microversion: 2.1 time: 0.031004 Mar 30 07:26:46.362875 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 528/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:46 2022] GET /compute/v2.1/servers/153dd568-5bf9-4ddc-9221-8fe74c4bd58b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:46.827124 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:46.827745 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.compute.api [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117063) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:46.834545 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:46.834987 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:46.835751 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:46.836299 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG oslo_concurrency.lockutils [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:46.849508 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] HTTP exception thrown: Instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b could not be found. Mar 30 07:26:46.850088 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Returning 404 to user: Instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:46.850903 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-59c0488d-ec63-4cfc-ba4a-f39ad46203df tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 404 len: 111 microversion: 2.1 time: 0.027784 Mar 30 07:26:46.851427 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 509/1037] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Mar 30 07:26:46 2022] DELETE /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:46.860208 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:46.860829 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.compute.api [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] [instance: 8a76b506-9c23-4b23-a6e2-7c35a67f853b] Fetching instance by UUID {{(pid=117062) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 30 07:26:46.867330 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:46.867767 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:46.868570 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 30 07:26:46.869005 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG oslo_concurrency.lockutils [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Lock "fcfd7f92-7637-4043-bb9c-f82c3302f9e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 30 07:26:46.882638 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] HTTP exception thrown: Instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b could not be found. Mar 30 07:26:46.883225 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Returning 404 to user: Instance 8a76b506-9c23-4b23-a6e2-7c35a67f853b could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:46.884091 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-d1e3e82e-1e6e-4191-974e-9de3f2d14bb7 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b" status: 404 len: 111 microversion: 2.1 time: 0.027960 Mar 30 07:26:46.884619 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 529/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Mar 30 07:26:46 2022] GET /compute/v2.1/servers/8a76b506-9c23-4b23-a6e2-7c35a67f853b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:47.301136 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-7b0fc73e-2b24-4b01-87e0-1156defe3a15 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154c0f01f0>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:47.330649 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-7b0fc73e-2b24-4b01-87e0-1156defe3a15 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e" status: 200 len: 286 microversion: 2.1 time: 0.036103 Mar 30 07:26:47.331194 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 510/1039] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Mar 30 07:26:47 2022] GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:48.347651 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-1ad97f17-638c-4f83-a082-7dedf01607e7 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154d216940>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:48.386176 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-1ad97f17-638c-4f83-a082-7dedf01607e7 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e" status: 200 len: 286 microversion: 2.1 time: 0.045217 Mar 30 07:26:48.386742 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 530/1040] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Mar 30 07:26:48 2022] GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:49.400606 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-96dc05a8-2636-4484-8350-ab65d6b8e507 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154c098940>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:49.435288 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-96dc05a8-2636-4484-8350-ab65d6b8e507 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e" status: 200 len: 287 microversion: 2.1 time: 0.040146 Mar 30 07:26:49.435856 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 511/1041] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Mar 30 07:26:49 2022] GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:49.447033 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-5c1c69ac-3daa-44e9-8d67-279d0f2b185c tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154c5b2f70>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:49.510000 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-5c1c69ac-3daa-44e9-8d67-279d0f2b185c tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e" status: 202 len: 0 microversion: 2.1 time: 0.066884 Mar 30 07:26:49.511189 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 531/1042] 10.222.0.20 () {58 vars in 1253 bytes} [Wed Mar 30 07:26:49 2022] DELETE /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:26:49.523882 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-fed346f3-a2d8-4e2b-aa09-f7a6c7dae42d tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154c098a60>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:49.559056 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-fed346f3-a2d8-4e2b-aa09-f7a6c7dae42d tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e" status: 200 len: 286 microversion: 2.1 time: 0.041361 Mar 30 07:26:49.559620 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 512/1043] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Mar 30 07:26:49 2022] GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 30 07:26:50.320415 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-9c4ab008-ecb8-4bee-8cdd-85567a3db266 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] Calling method '.version_select at 0x7f154d13b040>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:50.346330 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-9c4ab008-ecb8-4bee-8cdd-85567a3db266 tempest-TestVolumeBootPattern-1807991008 tempest-TestVolumeBootPattern-1807991008-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1669774890" status: 202 len: 0 microversion: 2.1 time: 0.030555 Mar 30 07:26:50.347026 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 532/1044] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Mar 30 07:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1669774890 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:26:50.571753 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-339a3f29-5817-4cfb-a211-84e78025075d tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f153fe86e50>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:50.598527 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-339a3f29-5817-4cfb-a211-84e78025075d tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] HTTP exception thrown: Snapshot 8c44102a-4520-4013-be71-867832dc917e could not be found. Mar 30 07:26:50.599525 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-339a3f29-5817-4cfb-a211-84e78025075d tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Returning 404 to user: Snapshot 8c44102a-4520-4013-be71-867832dc917e could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:50.600493 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-339a3f29-5817-4cfb-a211-84e78025075d tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e" status: 404 len: 111 microversion: 2.1 time: 0.033244 Mar 30 07:26:50.601045 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 513/1045] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Mar 30 07:26:50 2022] GET /compute/v2.1/os-snapshots/8c44102a-4520-4013-be71-867832dc917e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:50.610488 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-3b81858f-2ba4-4816-a87d-97c80894a258 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154c5ba310>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:50.671258 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-3b81858f-2ba4-4816-a87d-97c80894a258 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd" status: 202 len: 0 microversion: 2.1 time: 0.065165 Mar 30 07:26:50.671858 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 533/1046] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:26:50 2022] DELETE /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 30 07:26:50.680728 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-b2ebb9f0-2f63-48e3-bcfb-dc2bc274abde tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154c098c10>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:50.730349 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-b2ebb9f0-2f63-48e3-bcfb-dc2bc274abde tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd" status: 200 len: 345 microversion: 2.1 time: 0.053742 Mar 30 07:26:50.730924 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 514/1047] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:26:50 2022] GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 30 07:26:51.744034 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0bfd33c6-9507-429b-8788-f2ad086a58cb tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154e51d5e0>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:51.771571 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-0bfd33c6-9507-429b-8788-f2ad086a58cb tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] HTTP exception thrown: Volume cb13f0dc-84ba-4f57-8788-56e4ba24d2fd could not be found. Mar 30 07:26:51.772201 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-0bfd33c6-9507-429b-8788-f2ad086a58cb tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Returning 404 to user: Volume cb13f0dc-84ba-4f57-8788-56e4ba24d2fd could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:51.773035 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-0bfd33c6-9507-429b-8788-f2ad086a58cb tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd" status: 404 len: 109 microversion: 2.1 time: 0.033967 Mar 30 07:26:51.773578 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 534/1048] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:26:51 2022] GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:51.787828 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f5ab659c-7770-4976-bf70-eeb70a82d737 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f153fe86e50>' {{(pid=117063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:51.815714 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.wsgi [None req-f5ab659c-7770-4976-bf70-eeb70a82d737 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] HTTP exception thrown: Volume cb13f0dc-84ba-4f57-8788-56e4ba24d2fd could not be found. Mar 30 07:26:51.816335 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: DEBUG nova.api.openstack.wsgi [None req-f5ab659c-7770-4976-bf70-eeb70a82d737 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Returning 404 to user: Volume cb13f0dc-84ba-4f57-8788-56e4ba24d2fd could not be found. {{(pid=117063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:51.817165 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO nova.api.openstack.requestlog [None req-f5ab659c-7770-4976-bf70-eeb70a82d737 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd" status: 404 len: 109 microversion: 2.1 time: 0.033858 Mar 30 07:26:51.817899 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: [pid: 117063|app: 0|req: 515/1049] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Mar 30 07:26:51 2022] DELETE /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:26:51.826684 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-18061942-bb77-4d2c-879f-a84194764656 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Calling method '.version_select at 0x7f154d0a9670>' {{(pid=117062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 30 07:26:51.854438 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.wsgi [None req-18061942-bb77-4d2c-879f-a84194764656 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] HTTP exception thrown: Volume cb13f0dc-84ba-4f57-8788-56e4ba24d2fd could not be found. Mar 30 07:26:51.855014 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: DEBUG nova.api.openstack.wsgi [None req-18061942-bb77-4d2c-879f-a84194764656 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] Returning 404 to user: Volume cb13f0dc-84ba-4f57-8788-56e4ba24d2fd could not be found. {{(pid=117062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 30 07:26:51.855862 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO nova.api.openstack.requestlog [None req-18061942-bb77-4d2c-879f-a84194764656 tempest-VolumesSnapshotsTestJSON-1909030723 tempest-VolumesSnapshotsTestJSON-1909030723-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd" status: 404 len: 109 microversion: 2.1 time: 0.033746 Mar 30 07:26:51.856396 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: [pid: 117062|app: 0|req: 535/1050] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Mar 30 07:26:51 2022] GET /compute/v2.1/os-volumes/cb13f0dc-84ba-4f57-8788-56e4ba24d2fd => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 30 07:27:14.499400 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:27:14.500761 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: Wed Mar 30 07:27:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:28:58.566070 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:28:58.566905 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: Wed Mar 30 07:28:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:29:14.039686 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:29:14.040736 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: Wed Mar 30 07:29:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:29:18.550948 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:29:18.551915 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: Wed Mar 30 07:29:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:29:43.307481 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:29:43.308584 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: Wed Mar 30 07:29:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:30:34.510917 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:30:34.511600 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: Wed Mar 30 07:30:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:30:49.962811 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:30:49.963566 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: Wed Mar 30 07:30:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:32:18.581244 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:32:18.582343 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: Wed Mar 30 07:32:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:32:34.052078 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:32:34.052748 dv-cinder-835778-2-iscsi devstack@n-api.service[117063]: Wed Mar 30 07:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 30 07:32:38.564680 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 30 07:32:38.565600 dv-cinder-835778-2-iscsi devstack@n-api.service[117062]: Wed Mar 30 07:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!